Jun 07 09:08:17.749725 ip-10-0-134-51 systemd[1]: Starting Kubernetes Kubelet... Jun 07 09:08:18.140251 ip-10-0-134-51 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 09:08:18.140251 ip-10-0-134-51 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 09:08:18.140251 ip-10-0-134-51 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 09:08:18.140251 ip-10-0-134-51 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 09:08:18.140251 ip-10-0-134-51 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 09:08:18.141243 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.141154 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 09:08:18.145776 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145759 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.145776 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145776 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145780 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145783 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145786 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145789 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145792 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145797 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145800 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145803 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145806 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145808 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145811 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145814 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145817 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145820 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145822 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145826 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145828 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145831 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.145853 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145834 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145836 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145839 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145841 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145844 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145847 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145851 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145854 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145857 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145860 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145863 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145866 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145870 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145873 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145876 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145879 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145881 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145884 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145886 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.146302 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145889 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145891 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145894 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145897 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145900 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145905 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145909 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145912 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145914 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145917 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145920 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145922 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145925 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145928 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145930 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145933 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145936 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145939 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145941 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145944 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.146784 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145947 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145950 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145952 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145955 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145957 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145960 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145962 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145965 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145967 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145970 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145972 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145975 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145977 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145980 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145982 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145985 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145988 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145990 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145993 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.147258 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145995 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.145998 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146000 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146003 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146005 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146008 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146011 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146013 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146016 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146019 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146021 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146024 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146027 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146029 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146032 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146035 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146037 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146039 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146042 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146044 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.147740 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146047 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146777 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146784 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146787 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146790 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146793 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146796 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146799 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146802 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146804 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146808 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146811 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146813 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146816 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146819 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146821 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146824 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146827 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146830 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146833 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.148219 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146837 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146840 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146843 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146845 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146848 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146850 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146853 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146856 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146858 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146861 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146863 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146866 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146871 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146874 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146877 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146880 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146883 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146886 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146889 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.148731 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146892 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146894 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146897 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146900 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146903 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146908 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146911 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146914 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146917 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146919 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146922 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146925 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146927 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146930 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146933 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146936 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146938 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146941 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146944 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.149215 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146946 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146949 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146951 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146954 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146957 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146959 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146962 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146964 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146967 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146969 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146972 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146974 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146976 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146979 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146981 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146984 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146987 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146990 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146993 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146996 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.149699 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.146999 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147002 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147004 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147007 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147009 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147012 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147016 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147020 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147023 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147026 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147029 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147031 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147034 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147037 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147041 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147044 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147047 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147050 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147052 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147055 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.150177 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147057 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147060 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147456 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147461 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147464 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147467 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147471 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147474 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147477 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147479 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147494 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147497 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147500 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147503 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147505 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147508 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147511 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147513 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147517 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147519 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.150721 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147522 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147525 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147528 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147530 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147533 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147535 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147538 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147540 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147543 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147546 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147548 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147550 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147553 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147556 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147559 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147561 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147564 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147567 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147569 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147572 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.151205 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147575 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147578 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.147581 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148643 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148648 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148652 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148656 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148659 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148662 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148664 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148667 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148670 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148673 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148676 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148678 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148681 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148683 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148686 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148689 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.151728 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148692 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148694 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148700 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148704 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148706 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148709 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148712 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148714 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148717 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148719 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148722 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148724 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148727 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148730 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148732 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148737 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148740 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148743 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148745 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148748 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.152199 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148750 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148753 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148756 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148758 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148760 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148763 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148765 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148768 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148770 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148774 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148777 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148780 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148783 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148786 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148790 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148793 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148795 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148798 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148801 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.152695 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148803 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148806 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.148809 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148884 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148896 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148905 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148912 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148918 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148925 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148930 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148935 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148939 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148942 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148946 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148949 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148952 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148955 2573 flags.go:64] FLAG: --cgroup-root="" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148958 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148961 2573 flags.go:64] FLAG: --client-ca-file="" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148964 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148967 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148972 2573 flags.go:64] FLAG: --cluster-domain="" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148975 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148978 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 09:08:18.153151 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148981 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148984 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148988 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148992 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148996 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.148999 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149002 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149005 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149008 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149011 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149014 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149019 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149021 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149024 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149027 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149030 2573 flags.go:64] FLAG: --enable-server="true" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149034 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149039 2573 flags.go:64] FLAG: --event-burst="100" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149042 2573 flags.go:64] FLAG: --event-qps="50" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149044 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149049 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149052 2573 flags.go:64] FLAG: --eviction-hard="" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149055 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149058 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149061 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 09:08:18.153748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149064 2573 flags.go:64] FLAG: --eviction-soft="" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149067 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149070 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149073 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149076 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149079 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149081 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149084 2573 flags.go:64] FLAG: --feature-gates="" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149088 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149091 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149095 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149099 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149102 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149105 2573 flags.go:64] FLAG: --help="false" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149108 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149111 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149114 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149117 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149120 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149123 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149126 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149129 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149132 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 09:08:18.154405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149136 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149139 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149142 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149145 2573 flags.go:64] FLAG: --kube-reserved="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149148 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149151 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149154 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149157 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149160 2573 flags.go:64] FLAG: --lock-file="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149162 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149165 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149169 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149174 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149177 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149179 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149182 2573 flags.go:64] FLAG: --logging-format="text" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149185 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149188 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149191 2573 flags.go:64] FLAG: --manifest-url="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149196 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149208 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149211 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149219 2573 flags.go:64] FLAG: --max-pods="110" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149222 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149225 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 09:08:18.155049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149228 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149232 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149235 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149238 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149240 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149248 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149250 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149254 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149257 2573 flags.go:64] FLAG: --pod-cidr="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149260 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149267 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149270 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149273 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149276 2573 flags.go:64] FLAG: --port="10250" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149279 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149282 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a31855ae272e87f" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149286 2573 flags.go:64] FLAG: --qos-reserved="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149288 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149291 2573 flags.go:64] FLAG: --register-node="true" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149294 2573 flags.go:64] FLAG: --register-with-taints="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149298 2573 flags.go:64] FLAG: --registry-burst="10" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149301 2573 flags.go:64] FLAG: --registry-qps="5" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149303 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149306 2573 flags.go:64] FLAG: --reserved-memory="" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149310 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 09:08:18.155776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149313 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149316 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149332 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149335 2573 flags.go:64] FLAG: --runonce="false" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149338 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149341 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149344 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149347 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149349 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149352 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149355 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149358 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149361 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149364 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149367 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149370 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149373 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149376 2573 flags.go:64] FLAG: --system-cgroups="" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149379 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149384 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149387 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149390 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149395 2573 flags.go:64] FLAG: --tls-min-version="" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149398 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149400 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 09:08:18.156419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149403 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149406 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149409 2573 flags.go:64] FLAG: --v="2" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149413 2573 flags.go:64] FLAG: --version="false" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149417 2573 flags.go:64] FLAG: --vmodule="" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149420 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.149423 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149573 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149578 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149581 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149585 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149588 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149590 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149593 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149596 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149598 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149600 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149603 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149606 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149610 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149613 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.157068 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149616 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149619 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149623 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149626 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149629 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149632 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149635 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149639 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149642 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149645 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149648 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149650 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149653 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149656 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149658 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149660 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149663 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149665 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149668 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.157602 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149671 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149673 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149676 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149678 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149681 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149683 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149686 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149688 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149691 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149693 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149696 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149698 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149700 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149703 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149706 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149708 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149711 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149714 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149716 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149719 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.158073 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149722 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149724 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149727 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149730 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149732 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149734 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149737 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149739 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149742 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149744 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149747 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149750 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149752 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149755 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149757 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149760 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149763 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149765 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149768 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149770 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.158666 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149773 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149775 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149778 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149780 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149783 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149787 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149789 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149792 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149794 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149797 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149800 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149802 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149805 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149807 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149810 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149813 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149815 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149818 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149820 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149823 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.159144 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149825 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149828 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149831 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149835 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149837 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.149840 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.150463 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.157777 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.157795 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.159177 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.159189 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159278 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159283 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159286 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159290 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.159664 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159293 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159296 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159299 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159302 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159305 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159309 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159313 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159316 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159333 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159349 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159352 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159355 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159358 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159361 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159364 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159366 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159369 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159371 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159374 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.160110 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159377 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159379 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159382 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159384 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159387 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159390 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159400 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159404 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159406 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159409 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159412 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159415 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159418 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159420 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159423 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159427 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159430 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159433 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159436 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159439 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.160604 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159442 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159444 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159447 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159449 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159452 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159455 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159457 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159460 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159462 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159465 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159468 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159470 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159473 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159475 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159478 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159480 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159492 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159496 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159498 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159507 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.161093 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159510 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159513 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159516 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159518 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159521 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159523 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159526 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159528 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159531 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159533 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159536 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159538 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159541 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159543 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159546 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159548 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159551 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159553 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159556 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159559 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.161616 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159561 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159564 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159567 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159571 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159574 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159577 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159580 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159582 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159585 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159588 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159590 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159593 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159601 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159604 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159606 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.162095 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159609 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.159614 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159784 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159790 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159793 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159796 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159799 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159802 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159805 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159807 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159810 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159812 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159816 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159819 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159822 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 09:08:18.162592 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159824 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159827 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159830 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159832 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159835 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159837 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159840 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159842 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159845 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159848 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159850 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159853 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159855 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159860 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159864 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159872 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159875 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159877 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159880 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159883 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 09:08:18.162973 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159886 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159888 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159891 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159895 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159897 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159900 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159903 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159906 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159908 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159911 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159913 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159916 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159918 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159921 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159924 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159926 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159928 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159931 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159933 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159936 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 09:08:18.163470 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159939 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159941 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159943 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159946 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159948 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159951 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159953 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159956 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159964 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159967 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159970 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159974 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159977 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159979 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159982 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159985 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159988 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159991 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159994 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.159997 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 09:08:18.163966 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160000 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160002 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160005 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160008 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160010 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160013 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160015 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160018 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160020 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160023 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160025 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160028 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160030 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160033 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160035 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160038 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160041 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160043 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160045 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160048 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 09:08:18.164461 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160050 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160058 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160061 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160064 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160066 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:18.160070 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.160075 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.160214 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.162400 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.163723 2573 server.go:1019] "Starting client certificate rotation" Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.163824 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 09:08:18.164939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.163864 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 09:08:18.168556 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.168411 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 09:08:18.173475 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.173453 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 09:08:18.184046 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.184027 2573 log.go:25] "Validated CRI v1 runtime API" Jun 07 09:08:18.186812 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.186794 2573 log.go:25] "Validated CRI v1 image API" Jun 07 09:08:18.188128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.188108 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 09:08:18.190407 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.190379 2573 fs.go:135] Filesystem UUIDs: map[4c1f95ae-f753-4dac-98c7-10289ef0a4ab:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7dfab0e5-6b90-454f-95be-06d2009eb730:/dev/nvme0n1p4] Jun 07 09:08:18.190502 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.190406 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 09:08:18.195223 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.195201 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 09:08:18.195548 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.195420 2573 manager.go:216] Machine: {Timestamp:2026-06-07 09:08:18.194156944 +0000 UTC m=+0.331027013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100329 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27dddf4f5b55f6097b4ff1c8efa711 SystemUUID:ec27dddf-4f5b-55f6-097b-4ff1c8efa711 BootID:fc69f8fd-cc4c-4483-bc2d-2e5515521560 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:5a:9f:8a:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:5a:9f:8a:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:ed:f4:c9:04:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 09:08:18.195548 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.195548 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 09:08:18.195697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.195659 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 09:08:18.198651 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.198629 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 09:08:18.198786 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.198654 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 09:08:18.199890 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.199880 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 09:08:18.199930 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.199893 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 09:08:18.199930 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.199901 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 09:08:18.200556 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.200546 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 09:08:18.201345 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.201334 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 09:08:18.204338 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204313 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 07 09:08:18.204478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204468 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 09:08:18.204509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204501 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 07 09:08:18.204536 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204517 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 09:08:18.204536 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204535 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 09:08:18.204592 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204548 2573 kubelet.go:398] "Adding apiserver pod source" Jun 07 09:08:18.204592 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204561 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 09:08:18.204938 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204926 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 09:08:18.204994 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.204944 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 09:08:18.207527 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.207512 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 09:08:18.208985 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.208960 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 09:08:18.209083 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.209010 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 09:08:18.210111 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210097 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210123 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210136 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210151 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210167 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210175 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 09:08:18.210185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210187 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 09:08:18.210418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210196 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 09:08:18.210418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210205 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 09:08:18.210418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210214 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 09:08:18.210418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210227 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 09:08:18.210418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.210247 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 09:08:18.211054 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.211043 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 09:08:18.211102 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.211056 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 09:08:18.215032 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.215003 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 09:08:18.215369 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.215350 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 09:08:18.215419 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.215351 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 09:08:18.216300 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.216287 2573 server.go:1268] "Started kubelet" Jun 07 09:08:18.216758 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.216465 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 09:08:18.216856 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.216825 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 09:08:18.216916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.216687 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 09:08:18.217661 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.217638 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mp28h" Jun 07 09:08:18.217657 ip-10-0-134-51 systemd[1]: Started Kubernetes Kubelet. Jun 07 09:08:18.219379 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.219358 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 09:08:18.220138 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.220122 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 07 09:08:18.223454 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.222564 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-51.ec2.internal.18b6c15ac1ead501 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-51.ec2.internal,UID:ip-10-0-134-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-51.ec2.internal,},FirstTimestamp:2026-06-07 09:08:18.216219905 +0000 UTC m=+0.353089975,LastTimestamp:2026-06-07 09:08:18.216219905 +0000 UTC m=+0.353089975,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-51.ec2.internal,}" Jun 07 09:08:18.223615 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.223600 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 09:08:18.224061 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224041 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 09:08:18.224146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224110 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 09:08:18.224146 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.224129 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.224697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224679 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 09:08:18.224697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224696 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 09:08:18.224830 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224679 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 09:08:18.224830 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224821 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 07 09:08:18.224830 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224829 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 07 09:08:18.224965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224949 2573 factory.go:55] Registering systemd factory Jun 07 09:08:18.224965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.224963 2573 factory.go:223] Registration of the systemd container factory successfully Jun 07 09:08:18.225212 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225196 2573 factory.go:153] Registering CRI-O factory Jun 07 09:08:18.225295 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225232 2573 factory.go:223] Registration of the crio container factory successfully Jun 07 09:08:18.225295 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225273 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 09:08:18.225295 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225291 2573 factory.go:103] Registering Raw factory Jun 07 09:08:18.225466 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225301 2573 manager.go:1196] Started watching for new ooms in manager Jun 07 09:08:18.225604 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225587 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mp28h" Jun 07 09:08:18.225723 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.225709 2573 manager.go:349] Starting recovery of all containers Jun 07 09:08:18.236532 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.236273 2573 manager.go:354] Recovery completed Jun 07 09:08:18.236602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.236583 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:18.242268 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.242255 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.243603 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.243587 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-51.ec2.internal\" not found" node="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.246180 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246165 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.246251 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246196 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.246251 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246212 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.246780 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246766 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 09:08:18.246780 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246776 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.246860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246780 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 09:08:18.246860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.246800 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 07 09:08:18.247520 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.247503 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.247600 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.247534 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.247600 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.247548 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.248033 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.248022 2573 policy_none.go:49] "None policy: Start" Jun 07 09:08:18.248068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.248037 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 09:08:18.248068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.248048 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 09:08:18.249134 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.249123 2573 policy_none.go:47] "Start" Jun 07 09:08:18.290887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.290871 2573 manager.go:337] "Starting Device Plugin manager" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.290909 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.290922 2573 server.go:87] "Starting device plugin registration server" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.291157 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.291170 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.291240 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.291356 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.291367 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.291964 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.292026 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.294933 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.296014 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.296046 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.296062 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.296089 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 09:08:18.299836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.298391 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:18.391780 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.391726 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.392807 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.392792 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.392916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.392827 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.392916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.392841 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.392916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.392870 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.396850 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.396832 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal"] Jun 07 09:08:18.396927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.396890 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.397656 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.397640 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.397722 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.397672 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.397722 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.397684 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.398994 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.398982 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.399112 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.399153 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399131 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.399689 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399675 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.399750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399702 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.399750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399716 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.399750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399724 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.399750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399744 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.399887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.399757 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.400835 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.400817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.400884 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.400854 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 09:08:18.401502 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.401483 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientMemory" Jun 07 09:08:18.401502 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.401505 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 09:08:18.401624 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.401516 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeHasSufficientPID" Jun 07 09:08:18.401786 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.401772 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.401847 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.401791 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-51.ec2.internal\": node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.414990 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.414973 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.426198 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.426182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d95acaf121a5db44d921cba276291dbe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-51.ec2.internal\" (UID: \"d95acaf121a5db44d921cba276291dbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.426282 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.426204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.426282 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.426222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.433964 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.433949 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-51.ec2.internal\" not found" node="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.438272 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.438258 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-51.ec2.internal\" not found" node="ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.516017 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.515991 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.526650 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d95acaf121a5db44d921cba276291dbe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-51.ec2.internal\" (UID: \"d95acaf121a5db44d921cba276291dbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.526769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.526769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.526769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.526769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b23c0a975ea2dda07dbf40ca419ed5af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal\" (UID: \"b23c0a975ea2dda07dbf40ca419ed5af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.526769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.526745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d95acaf121a5db44d921cba276291dbe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-51.ec2.internal\" (UID: \"d95acaf121a5db44d921cba276291dbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.616857 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.616820 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.717672 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.717592 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.738102 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.738082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.742693 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:18.742677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:18.818407 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.818373 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:18.918941 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:18.918916 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.019449 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.019367 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.119953 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.119929 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.163413 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.163375 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 09:08:19.164085 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.163555 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 09:08:19.164085 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.163559 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 09:08:19.220465 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.220434 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.228289 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.228249 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 09:03:18 +0000 UTC" deadline="2027-11-20 01:56:18.827316775 +0000 UTC" Jun 07 09:08:19.228289 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.228287 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12736h47m59.599034126s" Jun 07 09:08:19.249976 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:19.249946 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23c0a975ea2dda07dbf40ca419ed5af.slice/crio-14e6498578d2c2c757fb07e2ddd1be10b03e59c8e8cf2d31ac393df0040042cf WatchSource:0}: Error finding container 14e6498578d2c2c757fb07e2ddd1be10b03e59c8e8cf2d31ac393df0040042cf: Status 404 returned error can't find the container with id 14e6498578d2c2c757fb07e2ddd1be10b03e59c8e8cf2d31ac393df0040042cf Jun 07 09:08:19.250176 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:19.250159 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95acaf121a5db44d921cba276291dbe.slice/crio-f713526399239115e26643869d6b464bc7d5e0ba26b96f6e98c002b03e2f1078 WatchSource:0}: Error finding container f713526399239115e26643869d6b464bc7d5e0ba26b96f6e98c002b03e2f1078: Status 404 returned error can't find the container with id f713526399239115e26643869d6b464bc7d5e0ba26b96f6e98c002b03e2f1078 Jun 07 09:08:19.254664 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.254649 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 09:08:19.299363 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.299239 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" event={"ID":"b23c0a975ea2dda07dbf40ca419ed5af","Type":"ContainerStarted","Data":"14e6498578d2c2c757fb07e2ddd1be10b03e59c8e8cf2d31ac393df0040042cf"} Jun 07 09:08:19.300273 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.300249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" event={"ID":"d95acaf121a5db44d921cba276291dbe","Type":"ContainerStarted","Data":"f713526399239115e26643869d6b464bc7d5e0ba26b96f6e98c002b03e2f1078"} Jun 07 09:08:19.321409 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.321387 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.421979 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.421932 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.522479 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.522435 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.623072 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:19.622984 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-51.ec2.internal\" not found" Jun 07 09:08:19.707678 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.707649 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:19.724370 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.724336 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" Jun 07 09:08:19.734155 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.734127 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 09:08:19.736574 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.736553 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" Jun 07 09:08:19.745644 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.745609 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 09:08:19.787379 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.787315 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:19.977254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:19.977180 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:20.205674 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.205642 2573 apiserver.go:52] "Watching apiserver" Jun 07 09:08:20.211795 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.211773 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 09:08:20.213340 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.213297 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xwp9z","kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4","openshift-dns/node-resolver-f4x4t","openshift-image-registry/node-ca-x29gk","openshift-multus/network-metrics-daemon-n9bfz","openshift-network-diagnostics/network-check-target-nnmmj","kube-system/konnectivity-agent-vrntq","openshift-cluster-node-tuning-operator/tuned-gp7gs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal","openshift-multus/multus-additional-cni-plugins-spxgp","openshift-multus/multus-sm6ds","openshift-network-operator/iptables-alerter-s8mwx","openshift-ovn-kubernetes/ovnkube-node-llkrp"] Jun 07 09:08:20.215853 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.215833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:20.215940 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.215900 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:20.218027 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.217996 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.219741 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.219722 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.219868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.219822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.220218 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.220042 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.220218 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.220079 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 09:08:20.220218 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.220119 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pjz5b\"" Jun 07 09:08:20.221775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.221759 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.222007 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.221989 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jsmkt\"" Jun 07 09:08:20.222095 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.222019 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 09:08:20.222166 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.222149 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.222295 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.222260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.223828 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.223809 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcfzd\"" Jun 07 09:08:20.223925 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.223812 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.223985 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.223972 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.224470 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.224398 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 09:08:20.224568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.224507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.226097 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.226068 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 09:08:20.226097 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.226093 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.226232 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.226166 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.226472 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.226438 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5nrcm\"" Jun 07 09:08:20.226738 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.226701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.226818 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.226765 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:20.228933 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.228889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.230626 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.230608 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.230626 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.230624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jnx7z\"" Jun 07 09:08:20.230771 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.230755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.231067 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.231051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.231155 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.231119 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:20.234288 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.233644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235663 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9519ca8e-0bb4-495c-b4eb-f507e474f042-iptables-alerter-script\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7wt\" (UniqueName: \"kubernetes.io/projected/0b3949b1-e182-46b2-a91e-5249a1b8244d-kube-api-access-8r7wt\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad85837-4cce-431b-bd65-91545c75bed8-hosts-file\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235798 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h4w9\" (UniqueName: \"kubernetes.io/projected/6ad85837-4cce-431b-bd65-91545c75bed8-kube-api-access-8h4w9\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-serviceca\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlz64\" (UniqueName: \"kubernetes.io/projected/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-kube-api-access-nlz64\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.235898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236011 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7khqb\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236019 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236127 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236164 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236317 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236423 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.237123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.236584 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2t8\" (UniqueName: \"kubernetes.io/projected/9519ca8e-0bb4-495c-b4eb-f507e474f042-kube-api-access-9m2t8\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-device-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-sys-fs\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9519ca8e-0bb4-495c-b4eb-f507e474f042-host-slash\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-socket-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-registration-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad85837-4cce-431b-bd65-91545c75bed8-tmp-dir\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-host\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.238160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.237664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8m9x\" (UniqueName: \"kubernetes.io/projected/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-kube-api-access-q8m9x\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.238806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.238444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 09:08:20.238806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.238510 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 09:08:20.238806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.238521 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tml4x\"" Jun 07 09:08:20.239937 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.239919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.241662 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241645 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 09:08:20.241806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241768 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 09:08:20.241900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241807 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 09:08:20.241900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241815 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 09:08:20.242005 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241905 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9x2v\"" Jun 07 09:08:20.242005 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.241905 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 09:08:20.242349 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.242314 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.243721 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.243704 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 09:08:20.243865 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.243841 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wmwzk\"" Jun 07 09:08:20.268988 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.268965 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bdkz4" Jun 07 09:08:20.268988 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.268990 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bdkz4" Jun 07 09:08:20.326352 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.326315 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 09:08:20.338591 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-cnibin\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.338754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysconfig\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.338754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-device-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.338754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.338754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338696 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-device-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.338927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-sys\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.338927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9519ca8e-0bb4-495c-b4eb-f507e474f042-host-slash\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.338927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9519ca8e-0bb4-495c-b4eb-f507e474f042-host-slash\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.338927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-registration-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-k8s-cni-cncf-io\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-netns\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-registration-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.338984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-systemd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-env-overrides\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9519ca8e-0bb4-495c-b4eb-f507e474f042-iptables-alerter-script\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.339113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-config\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2t8\" (UniqueName: \"kubernetes.io/projected/9519ca8e-0bb4-495c-b4eb-f507e474f042-kube-api-access-9m2t8\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-system-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-cnibin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-os-release\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-kubelet\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-netd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-socket-dir-parent\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.339509 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-conf\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-host\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-socket-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7nvk\" (UniqueName: \"kubernetes.io/projected/7c68b534-359f-4980-bda0-e1303dbe4c85-kube-api-access-n7nvk\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-var-lib-kubelet\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8m9x\" (UniqueName: \"kubernetes.io/projected/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-kube-api-access-q8m9x\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad85837-4cce-431b-bd65-91545c75bed8-hosts-file\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-kubelet-config\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-slash\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-tmp\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339830 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9519ca8e-0bb4-495c-b4eb-f507e474f042-iptables-alerter-script\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-cni-binary-copy\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad85837-4cce-431b-bd65-91545c75bed8-hosts-file\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlp42\" (UniqueName: \"kubernetes.io/projected/42a6f693-2438-4166-8b76-8b0f4836cec0-kube-api-access-wlp42\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.340000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-modprobe-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-lib-modules\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-sys-fs\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-netns\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-log-socket\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-host\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-sys-fs\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-host\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-script-lib\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.339752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b3949b1-e182-46b2-a91e-5249a1b8244d-socket-dir\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-run\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.340769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4w9\" (UniqueName: \"kubernetes.io/projected/6ad85837-4cce-431b-bd65-91545c75bed8-kube-api-access-8h4w9\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.340527 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlz64\" (UniqueName: \"kubernetes.io/projected/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-kube-api-access-nlz64\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.340613 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:20.840575664 +0000 UTC m=+2.977445732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-dbus\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-binary-copy\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-hostroot\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-daemon-config\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-ovn\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-bin\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-systemd\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-etc-tuned\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340840 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-multus\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-systemd-units\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.341564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-etc-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340969 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovn-node-metrics-cert\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.340995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-agent-certs\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-konnectivity-ca\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-os-release\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad85837-4cce-431b-bd65-91545c75bed8-tmp-dir\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341090 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-conf-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vvf\" (UniqueName: \"kubernetes.io/projected/ad747180-0808-4e1f-b28b-8e7773c9f2ce-kube-api-access-p5vvf\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trvv\" (UniqueName: \"kubernetes.io/projected/324826e5-7c39-4881-8b39-816a13c38c91-kube-api-access-2trvv\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7wt\" (UniqueName: \"kubernetes.io/projected/0b3949b1-e182-46b2-a91e-5249a1b8244d-kube-api-access-8r7wt\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-serviceca\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-bin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-etc-kubernetes\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-var-lib-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad85837-4cce-431b-bd65-91545c75bed8-tmp-dir\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-node-log\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-kubernetes\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.342314 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-kubelet\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.343121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-multus-certs\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.343121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-system-cni-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.343121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.341671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-serviceca\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.344820 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.344496 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 09:08:20.346353 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.345747 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:20.346353 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.345770 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:20.346353 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.345789 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:20.346353 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.345872 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:20.845848664 +0000 UTC m=+2.982718731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:20.348776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.348750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4w9\" (UniqueName: \"kubernetes.io/projected/6ad85837-4cce-431b-bd65-91545c75bed8-kube-api-access-8h4w9\") pod \"node-resolver-f4x4t\" (UID: \"6ad85837-4cce-431b-bd65-91545c75bed8\") " pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.348776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.348763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2t8\" (UniqueName: \"kubernetes.io/projected/9519ca8e-0bb4-495c-b4eb-f507e474f042-kube-api-access-9m2t8\") pod \"iptables-alerter-s8mwx\" (UID: \"9519ca8e-0bb4-495c-b4eb-f507e474f042\") " pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.349707 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.349677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7wt\" (UniqueName: \"kubernetes.io/projected/0b3949b1-e182-46b2-a91e-5249a1b8244d-kube-api-access-8r7wt\") pod \"aws-ebs-csi-driver-node-tsxp4\" (UID: \"0b3949b1-e182-46b2-a91e-5249a1b8244d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.349964 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.349947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8m9x\" (UniqueName: \"kubernetes.io/projected/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-kube-api-access-q8m9x\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.350340 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.350211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlz64\" (UniqueName: \"kubernetes.io/projected/b3f8936d-8b23-47cb-9c6e-3e5e9d02f849-kube-api-access-nlz64\") pod \"node-ca-x29gk\" (UID: \"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849\") " pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.386369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.386343 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 09:08:20.442375 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-etc-kubernetes\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-var-lib-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-node-log\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-kubernetes\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442470 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-etc-kubernetes\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-node-log\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-kubelet\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-multus-certs\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-kubelet\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442558 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-kubernetes\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-multus-certs\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-var-lib-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-system-cni-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-cnibin\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysconfig\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-cnibin\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-sys\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-k8s-cni-cncf-io\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-netns\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysconfig\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-systemd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-env-overrides\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-sys\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-k8s-cni-cncf-io\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.442927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-config\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-run-netns\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-system-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-cnibin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.442998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-system-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-os-release\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-kubelet\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-cnibin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443043 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-systemd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-kubelet\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443001 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-system-cni-dir\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-netd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-netd\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-os-release\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-socket-dir-parent\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.443699 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-conf\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-host\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7nvk\" (UniqueName: \"kubernetes.io/projected/7c68b534-359f-4980-bda0-e1303dbe4c85-kube-api-access-n7nvk\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-var-lib-kubelet\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443279 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-kubelet-config\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-slash\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-tmp\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-cni-binary-copy\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlp42\" (UniqueName: \"kubernetes.io/projected/42a6f693-2438-4166-8b76-8b0f4836cec0-kube-api-access-wlp42\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-sysctl-conf\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-modprobe-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-lib-modules\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-env-overrides\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443476 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-host\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-netns\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-var-lib-kubelet\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.444602 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-config\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-netns\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-log-socket\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-kubelet-config\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-socket-dir-parent\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-script-lib\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-run\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-dbus\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443695 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-slash\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-binary-copy\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-hostroot\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.445453 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-daemon-config\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-ovn\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-bin\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-systemd\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.443907 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-etc-tuned\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-cni-bin\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.443992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-hostroot\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-multus\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-log-socket\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-systemd-units\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-cni-binary-copy\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-etc-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovn-node-metrics-cert\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-systemd\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-systemd-units\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444110 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-etc-openvswitch\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-cni-binary-copy\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-agent-certs\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-konnectivity-ca\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.444189 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:20.944171868 +0000 UTC m=+3.081041926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-os-release\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovnkube-script-lib\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c68b534-359f-4980-bda0-e1303dbe4c85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-conf-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-multus\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444342 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-run\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-conf-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444401 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vvf\" (UniqueName: \"kubernetes.io/projected/ad747180-0808-4e1f-b28b-8e7773c9f2ce-kube-api-access-p5vvf\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trvv\" (UniqueName: \"kubernetes.io/projected/324826e5-7c39-4881-8b39-816a13c38c91-kube-api-access-2trvv\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-bin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.446965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-host-var-lib-cni-bin\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-lib-modules\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-dbus\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444695 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad747180-0808-4e1f-b28b-8e7773c9f2ce-run-ovn\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c68b534-359f-4980-bda0-e1303dbe4c85-os-release\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-daemon-config\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42a6f693-2438-4166-8b76-8b0f4836cec0-multus-cni-dir\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.444967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324826e5-7c39-4881-8b39-816a13c38c91-etc-modprobe-d\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.445595 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-konnectivity-ca\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.446055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-tmp\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.446686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad747180-0808-4e1f-b28b-8e7773c9f2ce-ovn-node-metrics-cert\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.446859 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700-agent-certs\") pod \"konnectivity-agent-vrntq\" (UID: \"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700\") " pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.447800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.446879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324826e5-7c39-4881-8b39-816a13c38c91-etc-tuned\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.452248 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.452199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7nvk\" (UniqueName: \"kubernetes.io/projected/7c68b534-359f-4980-bda0-e1303dbe4c85-kube-api-access-n7nvk\") pod \"multus-additional-cni-plugins-spxgp\" (UID: \"7c68b534-359f-4980-bda0-e1303dbe4c85\") " pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.452248 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.452243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlp42\" (UniqueName: \"kubernetes.io/projected/42a6f693-2438-4166-8b76-8b0f4836cec0-kube-api-access-wlp42\") pod \"multus-sm6ds\" (UID: \"42a6f693-2438-4166-8b76-8b0f4836cec0\") " pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.452825 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.452807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vvf\" (UniqueName: \"kubernetes.io/projected/ad747180-0808-4e1f-b28b-8e7773c9f2ce-kube-api-access-p5vvf\") pod \"ovnkube-node-llkrp\" (UID: \"ad747180-0808-4e1f-b28b-8e7773c9f2ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.452917 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.452875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trvv\" (UniqueName: \"kubernetes.io/projected/324826e5-7c39-4881-8b39-816a13c38c91-kube-api-access-2trvv\") pod \"tuned-gp7gs\" (UID: \"324826e5-7c39-4881-8b39-816a13c38c91\") " pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.529953 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.529869 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8mwx" Jun 07 09:08:20.538845 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.538818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" Jun 07 09:08:20.548628 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.548604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f4x4t" Jun 07 09:08:20.552235 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.552214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x29gk" Jun 07 09:08:20.558975 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.558954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" Jun 07 09:08:20.565685 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.565666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:20.571352 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.571311 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:20.578054 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.578033 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spxgp" Jun 07 09:08:20.584663 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.584643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm6ds" Jun 07 09:08:20.848683 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.848613 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:20.848683 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.848646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848754 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848771 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848786 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848795 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848826 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:21.84879493 +0000 UTC m=+3.985664992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:20.848845 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.848842 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:21.848834527 +0000 UTC m=+3.985704589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:20.948936 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:20.948904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:20.949094 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.949007 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:20.949094 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:20.949071 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:21.949051172 +0000 UTC m=+4.085921237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:21.211188 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.211160 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9519ca8e_0bb4_495c_b4eb_f507e474f042.slice/crio-29334ba1190b18ab5f94f50d85bafd1a8a191e4d947a5c5038151bc8f1ad3085 WatchSource:0}: Error finding container 29334ba1190b18ab5f94f50d85bafd1a8a191e4d947a5c5038151bc8f1ad3085: Status 404 returned error can't find the container with id 29334ba1190b18ab5f94f50d85bafd1a8a191e4d947a5c5038151bc8f1ad3085 Jun 07 09:08:21.212538 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.212513 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324826e5_7c39_4881_8b39_816a13c38c91.slice/crio-98901f59c0b22f8d53127a1cb2753a44054e797d09544b93e18511e7c51791b3 WatchSource:0}: Error finding container 98901f59c0b22f8d53127a1cb2753a44054e797d09544b93e18511e7c51791b3: Status 404 returned error can't find the container with id 98901f59c0b22f8d53127a1cb2753a44054e797d09544b93e18511e7c51791b3 Jun 07 09:08:21.216433 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.216412 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f8936d_8b23_47cb_9c6e_3e5e9d02f849.slice/crio-c1622f412afd69327e0a1123809d8a544bbedbddb383aa5b7541fd8f5b74757f WatchSource:0}: Error finding container c1622f412afd69327e0a1123809d8a544bbedbddb383aa5b7541fd8f5b74757f: Status 404 returned error can't find the container with id c1622f412afd69327e0a1123809d8a544bbedbddb383aa5b7541fd8f5b74757f Jun 07 09:08:21.238284 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.238257 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b40fb1b_bdda_4ad9_8c6a_8ab7e3b4b700.slice/crio-6ca5b1902c93b99cbe6354efd255957a935e02d9d83f2729b037265245a1c86d WatchSource:0}: Error finding container 6ca5b1902c93b99cbe6354efd255957a935e02d9d83f2729b037265245a1c86d: Status 404 returned error can't find the container with id 6ca5b1902c93b99cbe6354efd255957a935e02d9d83f2729b037265245a1c86d Jun 07 09:08:21.239012 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.238992 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad85837_4cce_431b_bd65_91545c75bed8.slice/crio-365b3abba484e0f51ba667745fb143436bcc7903ee4010327abab75500d9f262 WatchSource:0}: Error finding container 365b3abba484e0f51ba667745fb143436bcc7903ee4010327abab75500d9f262: Status 404 returned error can't find the container with id 365b3abba484e0f51ba667745fb143436bcc7903ee4010327abab75500d9f262 Jun 07 09:08:21.244079 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.241502 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3949b1_e182_46b2_a91e_5249a1b8244d.slice/crio-e37f614eab1e11d9b8b57b6bef7f24b2016c3b33aa24bf25d9dd8503c4dad832 WatchSource:0}: Error finding container e37f614eab1e11d9b8b57b6bef7f24b2016c3b33aa24bf25d9dd8503c4dad832: Status 404 returned error can't find the container with id e37f614eab1e11d9b8b57b6bef7f24b2016c3b33aa24bf25d9dd8503c4dad832 Jun 07 09:08:21.246892 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:21.246858 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a6f693_2438_4166_8b76_8b0f4836cec0.slice/crio-3b789f90498dab2b73b7230cec97bd3e6796bf0552e9d2f691b6df6d80c97268 WatchSource:0}: Error finding container 3b789f90498dab2b73b7230cec97bd3e6796bf0552e9d2f691b6df6d80c97268: Status 404 returned error can't find the container with id 3b789f90498dab2b73b7230cec97bd3e6796bf0552e9d2f691b6df6d80c97268 Jun 07 09:08:21.272400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.272207 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 09:03:20 +0000 UTC" deadline="2027-12-23 14:00:49.561516014 +0000 UTC" Jun 07 09:08:21.272400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.272401 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13540h52m28.28911959s" Jun 07 09:08:21.296708 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.296688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:21.296810 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.296795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:21.307712 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.307683 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8mwx" event={"ID":"9519ca8e-0bb4-495c-b4eb-f507e474f042","Type":"ContainerStarted","Data":"29334ba1190b18ab5f94f50d85bafd1a8a191e4d947a5c5038151bc8f1ad3085"} Jun 07 09:08:21.308876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.308844 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerStarted","Data":"1e133c569b6db65c9eec09d3f36aae2292101c27c84bc9b00df15aa0c1c86f4d"} Jun 07 09:08:21.309937 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.309907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vrntq" event={"ID":"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700","Type":"ContainerStarted","Data":"6ca5b1902c93b99cbe6354efd255957a935e02d9d83f2729b037265245a1c86d"} Jun 07 09:08:21.310889 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.310865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" event={"ID":"324826e5-7c39-4881-8b39-816a13c38c91","Type":"ContainerStarted","Data":"98901f59c0b22f8d53127a1cb2753a44054e797d09544b93e18511e7c51791b3"} Jun 07 09:08:21.311868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.311849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm6ds" event={"ID":"42a6f693-2438-4166-8b76-8b0f4836cec0","Type":"ContainerStarted","Data":"3b789f90498dab2b73b7230cec97bd3e6796bf0552e9d2f691b6df6d80c97268"} Jun 07 09:08:21.312892 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.312872 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"2826cfc356c9cf2c33be84e265ebfda8839bc46b05c2646a3571b9524f94ed0e"} Jun 07 09:08:21.313846 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.313830 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f4x4t" event={"ID":"6ad85837-4cce-431b-bd65-91545c75bed8","Type":"ContainerStarted","Data":"365b3abba484e0f51ba667745fb143436bcc7903ee4010327abab75500d9f262"} Jun 07 09:08:21.314701 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.314681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" event={"ID":"0b3949b1-e182-46b2-a91e-5249a1b8244d","Type":"ContainerStarted","Data":"e37f614eab1e11d9b8b57b6bef7f24b2016c3b33aa24bf25d9dd8503c4dad832"} Jun 07 09:08:21.315569 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.315552 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x29gk" event={"ID":"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849","Type":"ContainerStarted","Data":"c1622f412afd69327e0a1123809d8a544bbedbddb383aa5b7541fd8f5b74757f"} Jun 07 09:08:21.856009 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.855922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:21.856009 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.855978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:21.856217 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856162 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:21.856217 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856180 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:21.856217 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856193 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:21.856403 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856258 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:23.856235897 +0000 UTC m=+5.993105974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:21.856723 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856695 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:21.856839 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.856758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:23.85674369 +0000 UTC m=+5.993613752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:21.956698 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:21.956662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:21.956883 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.956850 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:21.956945 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:21.956914 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:23.956895059 +0000 UTC m=+6.093765128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:22.273226 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.273133 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 09:03:20 +0000 UTC" deadline="2027-11-11 06:27:41.987750955 +0000 UTC" Jun 07 09:08:22.273226 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.273175 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12525h19m19.714580773s" Jun 07 09:08:22.299734 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.299061 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:22.299734 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:22.299185 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:22.299734 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.299580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:22.299734 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:22.299666 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:22.324024 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.323306 2573 generic.go:356] "Generic (PLEG): container finished" podID="b23c0a975ea2dda07dbf40ca419ed5af" containerID="de9d906a561b19c515d7e915b79e1359fca3c4b11eecc8213a7a32b97dfa99ac" exitCode=0 Jun 07 09:08:22.324024 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.323568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" event={"ID":"b23c0a975ea2dda07dbf40ca419ed5af","Type":"ContainerDied","Data":"de9d906a561b19c515d7e915b79e1359fca3c4b11eecc8213a7a32b97dfa99ac"} Jun 07 09:08:22.332455 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.332420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" event={"ID":"d95acaf121a5db44d921cba276291dbe","Type":"ContainerStarted","Data":"dc179b021813ef1a00108a308b2596ef4e8a0828a03018246cab59c2603fe68a"} Jun 07 09:08:22.348312 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:22.348254 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-51.ec2.internal" podStartSLOduration=3.348235412 podStartE2EDuration="3.348235412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:22.347510846 +0000 UTC m=+4.484380925" watchObservedRunningTime="2026-06-07 09:08:22.348235412 +0000 UTC m=+4.485105493" Jun 07 09:08:23.297202 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:23.297168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:23.297668 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.297306 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:23.349899 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:23.349863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" event={"ID":"b23c0a975ea2dda07dbf40ca419ed5af","Type":"ContainerStarted","Data":"2ef1ca24fe5e85a4176c0c197d9e4676dc6e27d833061efe84fe6dd51ccf0d50"} Jun 07 09:08:23.876062 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:23.876019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:23.876267 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:23.876132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:23.876267 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876252 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:23.876403 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876333 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:27.876300458 +0000 UTC m=+10.013170519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:23.876784 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876756 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:23.876784 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876783 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:23.876922 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876796 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:23.876922 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.876848 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:27.876830864 +0000 UTC m=+10.013700924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:23.976838 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:23.976799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:23.977009 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.976979 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:23.977085 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:23.977043 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:27.977024827 +0000 UTC m=+10.113894904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:24.296991 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:24.296914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:24.297141 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:24.297054 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:24.297556 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:24.296911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:24.297946 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:24.297560 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:25.296992 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:25.296477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:25.296992 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:25.296652 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:26.296603 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:26.296574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:26.297051 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:26.296709 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:26.297051 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:26.296766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:26.297051 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:26.296838 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:27.296362 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:27.296316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:27.296536 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.296499 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:27.910517 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:27.910481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:27.910532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910644 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910656 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910673 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910684 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:35.910687258 +0000 UTC m=+18.047557332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:27.910966 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:27.910780 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:35.910769389 +0000 UTC m=+18.047639449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:28.011182 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:28.011146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:28.011378 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:28.011294 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:28.011451 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:28.011415 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:36.011380928 +0000 UTC m=+18.148250988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:28.297157 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:28.297129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:28.299693 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:28.298544 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:28.299693 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:28.298883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:28.299693 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:28.299016 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:29.297722 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:29.297216 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:29.297722 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:29.297378 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:30.296585 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:30.296550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:30.296750 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:30.296679 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:30.296750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:30.296550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:30.296827 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:30.296791 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:31.296813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:31.296775 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:31.297226 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:31.296931 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:32.296591 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:32.296546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:32.296591 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:32.296591 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:32.297148 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:32.296687 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:32.297148 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:32.296822 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:33.296487 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:33.296456 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:33.296733 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:33.296594 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:34.297367 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:34.297333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:34.297991 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:34.297333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:34.297991 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:34.297440 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:34.297991 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:34.297546 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:35.296886 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:35.296853 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:35.297112 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.296981 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:35.966597 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:35.966562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:35.966597 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:35.966599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966719 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966735 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966750 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966763 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:08:51.96676935 +0000 UTC m=+34.103639430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:35.967093 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:35.966806 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:08:51.9667969 +0000 UTC m=+34.103666958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:36.067333 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:36.067279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:36.067501 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:36.067456 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:36.067560 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:36.067537 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:08:52.067512687 +0000 UTC m=+34.204382759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:36.297361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:36.297256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:36.297528 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:36.297410 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:36.297528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:36.297442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:36.297638 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:36.297540 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:37.297303 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:37.297265 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:37.297780 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:37.297435 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:38.297443 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:38.297400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:38.297830 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:38.297543 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:38.297830 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:38.297585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:38.297830 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:38.297712 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:39.296459 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:39.296421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:39.296633 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:39.296524 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:40.296634 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.296445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:40.297228 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:40.296732 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:40.297228 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.296777 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:40.297228 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:40.296852 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:40.394990 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.394973 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:08:40.395278 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395260 2573 generic.go:356] "Generic (PLEG): container finished" podID="ad747180-0808-4e1f-b28b-8e7773c9f2ce" containerID="7ac1846398cd508fc01e53a93518adbc40176c9d3675c4ac99de8b91f614bd29" exitCode=1 Jun 07 09:08:40.395354 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"0fecebb313adce25e1b7b577466280fef217ef3b68367f8de820b457f340be73"} Jun 07 09:08:40.395426 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"5ddae06ecb87d540c96692c517bb98e5bc18381a9c77b801e7bab48f888ac082"} Jun 07 09:08:40.395478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"f927be7b726c209b5c6ae68fbf7afeba6bb9eeca6d1871aecad8986ebd15a85a"} Jun 07 09:08:40.395528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395481 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerDied","Data":"7ac1846398cd508fc01e53a93518adbc40176c9d3675c4ac99de8b91f614bd29"} Jun 07 09:08:40.395528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.395510 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"a6b542b0c0faaa6ea54fabc1554a0cda0dc6af121536caa54b24cd2f542f42ca"} Jun 07 09:08:40.396541 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.396524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f4x4t" event={"ID":"6ad85837-4cce-431b-bd65-91545c75bed8","Type":"ContainerStarted","Data":"cc4d48daef1116203c181b9c1f5451513d69250d4768b7a091a477472ea3b53e"} Jun 07 09:08:40.397782 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.397765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" event={"ID":"0b3949b1-e182-46b2-a91e-5249a1b8244d","Type":"ContainerStarted","Data":"bc0ce2695ca78d575edcc9184ce151b90715c121c8b9afd95660d3c5b7e8e430"} Jun 07 09:08:40.399791 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.399424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x29gk" event={"ID":"b3f8936d-8b23-47cb-9c6e-3e5e9d02f849","Type":"ContainerStarted","Data":"3992f68d0e052be0ab47f18c6ade7badd9bce8bff40a917d940322785b8a3bbd"} Jun 07 09:08:40.402163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.402146 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="b4338d8d7b0e398ee2010fba1278e30d5d982593c4a5ffc58ba5739a50af4740" exitCode=0 Jun 07 09:08:40.402248 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.402228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"b4338d8d7b0e398ee2010fba1278e30d5d982593c4a5ffc58ba5739a50af4740"} Jun 07 09:08:40.403632 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.403610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vrntq" event={"ID":"0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700","Type":"ContainerStarted","Data":"b5ff3abefd2df5c60db1cfd21161a69794bf561f6405a05f663497cd8b8409db"} Jun 07 09:08:40.405214 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.405190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" event={"ID":"324826e5-7c39-4881-8b39-816a13c38c91","Type":"ContainerStarted","Data":"fb80727e4595ad292793c4347788ef4a551a465d0f8ab7fcc7a4716741701aed"} Jun 07 09:08:40.406639 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.406619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm6ds" event={"ID":"42a6f693-2438-4166-8b76-8b0f4836cec0","Type":"ContainerStarted","Data":"c958815e0728cff48e7daff7e9a97762f0373582305742c32ce2f40e6102b1f0"} Jun 07 09:08:40.409316 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.409279 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f4x4t" podStartSLOduration=3.960034062 podStartE2EDuration="22.409269111s" totalImagesPullingTime="18.449235049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:40.409053433 +0000 UTC m=+22.545923715" watchObservedRunningTime="2026-06-07 09:08:40.409269111 +0000 UTC m=+22.546139189" Jun 07 09:08:40.409561 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.409538 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-51.ec2.internal" podStartSLOduration=21.40953303 podStartE2EDuration="21.40953303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:23.363780692 +0000 UTC m=+5.500650772" watchObservedRunningTime="2026-06-07 09:08:40.40953303 +0000 UTC m=+22.546403110" Jun 07 09:08:40.423000 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.422951 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vrntq" podStartSLOduration=4.284837659 podStartE2EDuration="22.422937611s" totalImagesPullingTime="18.138099952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:40.422713147 +0000 UTC m=+22.559583226" watchObservedRunningTime="2026-06-07 09:08:40.422937611 +0000 UTC m=+22.559807685" Jun 07 09:08:40.451316 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.451279 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x29gk" podStartSLOduration=4.033941049 podStartE2EDuration="22.451262691s" totalImagesPullingTime="18.417321642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:40.450916254 +0000 UTC m=+22.587786331" watchObservedRunningTime="2026-06-07 09:08:40.451262691 +0000 UTC m=+22.588132772" Jun 07 09:08:40.465303 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.465253 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gp7gs" podStartSLOduration=3.989971029 podStartE2EDuration="22.465235672s" totalImagesPullingTime="18.475264643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:40.464920038 +0000 UTC m=+22.601790117" watchObservedRunningTime="2026-06-07 09:08:40.465235672 +0000 UTC m=+22.602105752" Jun 07 09:08:40.480256 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.480222 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sm6ds" podStartSLOduration=4.0123806 podStartE2EDuration="22.480209823s" totalImagesPullingTime="18.467829223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:40.480180562 +0000 UTC m=+22.617050642" watchObservedRunningTime="2026-06-07 09:08:40.480209823 +0000 UTC m=+22.617079915" Jun 07 09:08:40.768002 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:40.767973 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 09:08:41.297185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.297144 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:41.297681 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:41.297296 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:41.301556 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.301461 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T09:08:40.767993905Z","UUID":"0e70ec99-d7c8-4bdf-b364-cfd4e7cffe9d","Handler":null,"Name":"","Endpoint":""} Jun 07 09:08:41.303381 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.303362 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 09:08:41.303503 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.303406 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 09:08:41.412834 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.412693 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:08:41.413232 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.413205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"ff57a43c25d1283a84f0913f2dd74f482f6687cf3c31e8da88c580b9d9b27be9"} Jun 07 09:08:41.415170 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.415138 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" event={"ID":"0b3949b1-e182-46b2-a91e-5249a1b8244d","Type":"ContainerStarted","Data":"ee4d1c922324e8e27f6de8cf842d55f20023e6734b8ad84e051d286c33cc940e"} Jun 07 09:08:41.416913 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:41.416875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8mwx" event={"ID":"9519ca8e-0bb4-495c-b4eb-f507e474f042","Type":"ContainerStarted","Data":"4e188f3fa4dd7c27fe15866de2a7a06d639882997504c7e32d8ff9494d5d7cb6"} Jun 07 09:08:42.296925 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.296845 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:42.296925 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.296890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:42.297139 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:42.296982 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:42.297139 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:42.297094 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:42.421785 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.421733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" event={"ID":"0b3949b1-e182-46b2-a91e-5249a1b8244d","Type":"ContainerStarted","Data":"5956271f5f453eeec7e24fca05370614629b3b947206491e258610166a45d63b"} Jun 07 09:08:42.437706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.437656 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s8mwx" podStartSLOduration=5.981839669 podStartE2EDuration="24.43763916s" totalImagesPullingTime="18.455799491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:41.430599008 +0000 UTC m=+23.567469087" watchObservedRunningTime="2026-06-07 09:08:42.43763916 +0000 UTC m=+24.574509230" Jun 07 09:08:42.437990 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.437963 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsxp4" podStartSLOduration=4.027377068 podStartE2EDuration="24.437954101s" totalImagesPullingTime="20.410577033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:42.437377604 +0000 UTC m=+24.574247703" watchObservedRunningTime="2026-06-07 09:08:42.437954101 +0000 UTC m=+24.574824179" Jun 07 09:08:42.866401 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.866306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:42.953369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:42.953342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:43.296308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:43.296272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:43.296479 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:43.296434 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:43.427513 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:43.427485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:08:43.427972 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:43.427940 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"6de6a41f112f764c47a38f27f581137ad568ff04131bb208f905667fd752e9ea"} Jun 07 09:08:43.866341 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:43.866095 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:43.866754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:43.866729 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:44.297228 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.297187 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:44.297437 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:44.297366 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:44.300806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.298021 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:44.300806 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:44.298194 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:44.430870 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.430832 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:44.431413 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.431395 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vrntq" Jun 07 09:08:44.488250 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.488207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:44.690517 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.690485 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:44.791746 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:44.791610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:45.296659 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.296626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:45.296808 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:45.296741 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:45.435917 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.435749 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:08:45.436777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.436238 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"2e96599f5ce2faefd4ac2e7f97d999828660ffd1f93a9b0bf9b6cf6d6a675250"} Jun 07 09:08:45.436777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.436491 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:45.436777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.436553 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:45.436777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.436594 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:45.436777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.436720 2573 scope.go:117] "RemoveContainer" containerID="7ac1846398cd508fc01e53a93518adbc40176c9d3675c4ac99de8b91f614bd29" Jun 07 09:08:45.438398 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.438371 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="a5dee52e8bf4d3bbb00dad40f5fe8614121521cf1dd88e730597f676b86dbaae" exitCode=0 Jun 07 09:08:45.438557 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.438439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"a5dee52e8bf4d3bbb00dad40f5fe8614121521cf1dd88e730597f676b86dbaae"} Jun 07 09:08:45.452506 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.452465 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:45.453006 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:45.452987 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:08:46.296645 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.296614 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:46.296645 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.296635 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:46.296851 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:46.296746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:46.296949 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:46.296866 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:46.444604 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.444587 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:08:46.445074 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.445043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" event={"ID":"ad747180-0808-4e1f-b28b-8e7773c9f2ce","Type":"ContainerStarted","Data":"127982f6c3f83be53f45b999037ba5d9d47de43bb0b31f54fe04579e69d8f40c"} Jun 07 09:08:46.489007 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.488946 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" podStartSLOduration=9.978896794 podStartE2EDuration="28.48892866s" totalImagesPullingTime="18.510031866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:46.488034925 +0000 UTC m=+28.624905007" watchObservedRunningTime="2026-06-07 09:08:46.48892866 +0000 UTC m=+28.625798738" Jun 07 09:08:46.722803 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.722769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnmmj"] Jun 07 09:08:46.722941 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.722863 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:46.722985 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:46.722943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:46.726262 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.726227 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n9bfz"] Jun 07 09:08:46.726400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.726362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:46.726500 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:46.726480 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:46.726819 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.726797 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwp9z"] Jun 07 09:08:46.726894 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:46.726875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:46.726985 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:46.726963 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:47.449554 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:47.449513 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="fec39633f09bbfd9d692cf50294b5eafe92151366778a3c765d21ceec2facdd1" exitCode=0 Jun 07 09:08:47.450075 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:47.449598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"fec39633f09bbfd9d692cf50294b5eafe92151366778a3c765d21ceec2facdd1"} Jun 07 09:08:47.919372 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:47.919261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" limit=1024 Jun 07 09:08:48.299450 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:48.299425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:48.299450 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:48.299435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:48.299696 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:48.299554 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:48.299696 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:48.299605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:48.299804 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:48.299691 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:48.299858 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:48.299801 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:49.455734 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:49.455556 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="91c93857dbfdefe0c273089e74d96cedf953d3726c7927681b71497f9a0a4b1e" exitCode=0 Jun 07 09:08:49.456076 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:49.455630 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"91c93857dbfdefe0c273089e74d96cedf953d3726c7927681b71497f9a0a4b1e"} Jun 07 09:08:50.296757 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:50.296720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:50.296928 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:50.296720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:50.296928 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:50.296852 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:50.297048 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:50.296735 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:50.297048 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:50.296945 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:50.297048 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:50.297030 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:51.991125 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:51.991090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:51.991125 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:51.991129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991275 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991338 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991360 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991371 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:09:23.991348852 +0000 UTC m=+66.128218913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991373 2573 projected.go:196] Error preparing data for projected volume kube-api-access-llhvw for pod openshift-network-diagnostics/network-check-target-nnmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:51.991795 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:51.991431 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw podName:6740493f-9e7c-420b-94f9-015f472d48de nodeName:}" failed. No retries permitted until 2026-06-07 09:09:23.99141912 +0000 UTC m=+66.128289180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-llhvw" (UniqueName: "kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw") pod "network-check-target-nnmmj" (UID: "6740493f-9e7c-420b-94f9-015f472d48de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 09:08:52.092166 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:52.092128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:52.092372 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:52.092302 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:52.092448 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:52.092392 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret podName:2bb4d406-9fa8-4e9e-8e7c-09237bd4a618 nodeName:}" failed. No retries permitted until 2026-06-07 09:09:24.092370162 +0000 UTC m=+66.229240257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret") pod "global-pull-secret-syncer-xwp9z" (UID: "2bb4d406-9fa8-4e9e-8e7c-09237bd4a618") : object "kube-system"/"original-pull-secret" not registered Jun 07 09:08:52.297058 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:52.296967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:52.297058 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:52.296967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:52.297354 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:52.297104 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:08:52.297354 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:52.297118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:52.297354 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:52.297215 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnmmj" podUID="6740493f-9e7c-420b-94f9-015f472d48de" Jun 07 09:08:52.297354 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:52.297293 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwp9z" podUID="2bb4d406-9fa8-4e9e-8e7c-09237bd4a618" Jun 07 09:08:53.694143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.694114 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-51.ec2.internal" event="NodeReady" Jun 07 09:08:53.694752 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.694273 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 09:08:53.741797 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.741763 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vvqmb"] Jun 07 09:08:53.743419 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.743397 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6r69v"] Jun 07 09:08:53.743527 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.743509 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:53.746519 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.746240 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 09:08:53.746519 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.746287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmvt5\"" Jun 07 09:08:53.746706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.746555 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 09:08:53.747880 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.747858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:53.749552 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.749535 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 09:08:53.749655 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.749558 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gpvh7\"" Jun 07 09:08:53.749655 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.749587 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 09:08:53.749806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.749791 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 09:08:53.752638 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.752616 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r69v"] Jun 07 09:08:53.755970 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.755950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvqmb"] Jun 07 09:08:53.905220 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad605592-d021-490f-923d-c82b69d08d5d-config-volume\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:53.905220 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-cert\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:53.905423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad605592-d021-490f-923d-c82b69d08d5d-tmp-dir\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:53.905423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlv2\" (UniqueName: \"kubernetes.io/projected/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-kube-api-access-tjlv2\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:53.905423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:53.905423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:53.905360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrczk\" (UniqueName: \"kubernetes.io/projected/ad605592-d021-490f-923d-c82b69d08d5d-kube-api-access-mrczk\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.006417 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlv2\" (UniqueName: \"kubernetes.io/projected/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-kube-api-access-tjlv2\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:54.006417 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.006563 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrczk\" (UniqueName: \"kubernetes.io/projected/ad605592-d021-490f-923d-c82b69d08d5d-kube-api-access-mrczk\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.006563 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad605592-d021-490f-923d-c82b69d08d5d-config-volume\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.006563 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-cert\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:54.006563 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad605592-d021-490f-923d-c82b69d08d5d-tmp-dir\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.006563 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:54.006541 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:08:54.006732 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:54.006615 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:08:54.506594894 +0000 UTC m=+36.643464954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:08:54.006897 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.006878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad605592-d021-490f-923d-c82b69d08d5d-tmp-dir\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.007029 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.007013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad605592-d021-490f-923d-c82b69d08d5d-config-volume\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.010663 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.010636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-cert\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:54.014241 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.014218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrczk\" (UniqueName: \"kubernetes.io/projected/ad605592-d021-490f-923d-c82b69d08d5d-kube-api-access-mrczk\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.014364 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.014256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlv2\" (UniqueName: \"kubernetes.io/projected/ae78a710-9da2-48a9-96bc-f9c2a7e6a708-kube-api-access-tjlv2\") pod \"ingress-canary-6r69v\" (UID: \"ae78a710-9da2-48a9-96bc-f9c2a7e6a708\") " pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:54.060967 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.060940 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r69v" Jun 07 09:08:54.184611 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.184451 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r69v"] Jun 07 09:08:54.189412 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:08:54.189380 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae78a710_9da2_48a9_96bc_f9c2a7e6a708.slice/crio-6808d24ae1097ef615e1778a8ec4e1e22a0a41519342a8cfec28680c03bb0944 WatchSource:0}: Error finding container 6808d24ae1097ef615e1778a8ec4e1e22a0a41519342a8cfec28680c03bb0944: Status 404 returned error can't find the container with id 6808d24ae1097ef615e1778a8ec4e1e22a0a41519342a8cfec28680c03bb0944 Jun 07 09:08:54.296857 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.296815 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:08:54.297042 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.296815 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:08:54.297042 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.296955 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:08:54.299158 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299132 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 09:08:54.299158 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299145 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 09:08:54.299360 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299147 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 09:08:54.299360 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299228 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jh2fl\"" Jun 07 09:08:54.299360 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299130 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 09:08:54.299360 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.299225 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99ths\"" Jun 07 09:08:54.469146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.469063 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="6620dff8931024bbbe2fa4c45c1c5fb0b0373e8cfef4379d48ac290e46a8ec58" exitCode=0 Jun 07 09:08:54.469308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.469145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"6620dff8931024bbbe2fa4c45c1c5fb0b0373e8cfef4379d48ac290e46a8ec58"} Jun 07 09:08:54.470311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.470288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r69v" event={"ID":"ae78a710-9da2-48a9-96bc-f9c2a7e6a708","Type":"ContainerStarted","Data":"6808d24ae1097ef615e1778a8ec4e1e22a0a41519342a8cfec28680c03bb0944"} Jun 07 09:08:54.510593 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:54.510552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:54.510747 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:54.510722 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:08:54.510801 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:54.510788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:08:55.510773492 +0000 UTC m=+37.647643548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:08:55.477776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:55.477742 2573 generic.go:356] "Generic (PLEG): container finished" podID="7c68b534-359f-4980-bda0-e1303dbe4c85" containerID="5b19d8f7be83a79ba233c1866b60e7086cf6be08bf20fc01df469bb8a0d4f057" exitCode=0 Jun 07 09:08:55.478428 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:55.477792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerDied","Data":"5b19d8f7be83a79ba233c1866b60e7086cf6be08bf20fc01df469bb8a0d4f057"} Jun 07 09:08:55.518609 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:55.518563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:55.518751 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:55.518701 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:08:55.518800 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:55.518757 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:08:57.518742673 +0000 UTC m=+39.655612730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:08:56.482280 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:56.482049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r69v" event={"ID":"ae78a710-9da2-48a9-96bc-f9c2a7e6a708","Type":"ContainerStarted","Data":"9bfd31894dcaa7ade0b0cf523aaa16332cbedcdeb1731049219ae90fe61c1fcb"} Jun 07 09:08:56.485421 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:56.485397 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spxgp" event={"ID":"7c68b534-359f-4980-bda0-e1303dbe4c85","Type":"ContainerStarted","Data":"6dc27023bb0d595e29960993c5562faa15f1a3545e0324922f18135363f76b58"} Jun 07 09:08:56.496078 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:56.496034 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6r69v" podStartSLOduration=1.910334639 podStartE2EDuration="3.496022543s" totalImagesPullingTime="1.585687904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:56.494812271 +0000 UTC m=+38.631682350" watchObservedRunningTime="2026-06-07 09:08:56.496022543 +0000 UTC m=+38.632892600" Jun 07 09:08:56.514443 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:56.514389 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-spxgp" podStartSLOduration=9.810554513 podStartE2EDuration="38.514375774s" totalImagesPullingTime="28.703821261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:08:56.513175027 +0000 UTC m=+38.650045107" watchObservedRunningTime="2026-06-07 09:08:56.514375774 +0000 UTC m=+38.651245852" Jun 07 09:08:57.533271 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:08:57.533235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:08:57.533916 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:57.533395 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:08:57.533916 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:08:57.533465 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:09:01.533446567 +0000 UTC m=+43.670316629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:09:01.559701 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:01.559652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:09:01.560061 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:01.559797 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:09:01.560061 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:01.559856 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:09:09.55984056 +0000 UTC m=+51.696710617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:09:09.610248 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:09.610206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:09:09.610824 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:09.610361 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:09:09.610824 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:09.610425 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:09:25.610409123 +0000 UTC m=+67.747279180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:09:12.919621 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.919587 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf"] Jun 07 09:09:12.968379 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.968352 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv"] Jun 07 09:09:12.968517 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.968467 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:12.971649 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.971627 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 07 09:09:12.971788 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.971626 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 07 09:09:12.971788 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.971626 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 07 09:09:12.972127 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.972113 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 07 09:09:12.993889 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.993866 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf"] Jun 07 09:09:12.993996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.993897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv"] Jun 07 09:09:12.993996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.993972 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:12.995980 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.995961 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 07 09:09:12.996095 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.995963 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 07 09:09:12.996095 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.995994 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 07 09:09:12.996095 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:12.996002 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 07 09:09:13.032275 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.032400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.032400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/998e5418-0467-4dba-ad25-46e699d0733c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.032400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24fv\" (UniqueName: \"kubernetes.io/projected/998e5418-0467-4dba-ad25-46e699d0733c-kube-api-access-q24fv\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.032549 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5418-0467-4dba-ad25-46e699d0733c-tmp\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.032549 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.032549 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.032549 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqdjk\" (UniqueName: \"kubernetes.io/projected/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-kube-api-access-sqdjk\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.032700 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.032578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133057 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133171 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133230 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/998e5418-0467-4dba-ad25-46e699d0733c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.133230 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24fv\" (UniqueName: \"kubernetes.io/projected/998e5418-0467-4dba-ad25-46e699d0733c-kube-api-access-q24fv\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.133362 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5418-0467-4dba-ad25-46e699d0733c-tmp\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.133362 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133362 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133501 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqdjk\" (UniqueName: \"kubernetes.io/projected/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-kube-api-access-sqdjk\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133501 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.133703 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.133670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5418-0467-4dba-ad25-46e699d0733c-tmp\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.134051 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.134020 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.137143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.137117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-ca\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.137143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.137139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.137266 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.137165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.137266 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.137240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-hub\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.137380 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.137362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/998e5418-0467-4dba-ad25-46e699d0733c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.140418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.140395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqdjk\" (UniqueName: \"kubernetes.io/projected/dcdb2dba-9dd0-4849-ac7e-34622b71ad41-kube-api-access-sqdjk\") pod \"cluster-proxy-proxy-agent-698dcb769c-gq4sv\" (UID: \"dcdb2dba-9dd0-4849-ac7e-34622b71ad41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.140771 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.140751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24fv\" (UniqueName: \"kubernetes.io/projected/998e5418-0467-4dba-ad25-46e699d0733c-kube-api-access-q24fv\") pod \"klusterlet-addon-workmgr-7f845c6648-dpzdf\" (UID: \"998e5418-0467-4dba-ad25-46e699d0733c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.277149 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.277127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:13.310043 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.310013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:09:13.458123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.458095 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf"] Jun 07 09:09:13.475230 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.475204 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv"] Jun 07 09:09:13.478003 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:09:13.477973 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcdb2dba_9dd0_4849_ac7e_34622b71ad41.slice/crio-eee04d32ea1cc09f0a527ef69ec8e1737770bb858305140c3fae5570772ad4fc WatchSource:0}: Error finding container eee04d32ea1cc09f0a527ef69ec8e1737770bb858305140c3fae5570772ad4fc: Status 404 returned error can't find the container with id eee04d32ea1cc09f0a527ef69ec8e1737770bb858305140c3fae5570772ad4fc Jun 07 09:09:13.529095 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.529032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerStarted","Data":"eee04d32ea1cc09f0a527ef69ec8e1737770bb858305140c3fae5570772ad4fc"} Jun 07 09:09:13.530069 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:13.530051 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" event={"ID":"998e5418-0467-4dba-ad25-46e699d0733c","Type":"ContainerStarted","Data":"3538cd063ea46aebfe2585dab66170c879b4b5f0b628906e3f58204322f10c10"} Jun 07 09:09:17.468775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:17.468749 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llkrp" Jun 07 09:09:19.548980 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.548933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerStarted","Data":"0c6e483ec75c4ff7195231b47e3b7a43178de0dc16eaf6df427c298deba40f6d"} Jun 07 09:09:19.548980 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.548985 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerStarted","Data":"539fbc5de90fd936a6e8d45225b0c6875fbfadc1aa3b2eb7f181ac039da44cc4"} Jun 07 09:09:19.549447 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.549002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerStarted","Data":"6a089d89fa19c37c30fbd5ae322abd96dd304a2fefba458c8a03a3ed033a1ab7"} Jun 07 09:09:19.550502 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.550473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" event={"ID":"998e5418-0467-4dba-ad25-46e699d0733c","Type":"ContainerStarted","Data":"e4ca2bde1a1d70319e30b4e2aeb1e4a46ecd20c884337eaf0fcd853fbdfc0e95"} Jun 07 09:09:19.550685 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.550674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:19.552370 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.552349 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:09:19.565254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.565210 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" podStartSLOduration=2.204420471 podStartE2EDuration="7.565196702s" totalImagesPullingTime="5.360776231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:09:19.564199157 +0000 UTC m=+61.701069236" watchObservedRunningTime="2026-06-07 09:09:19.565196702 +0000 UTC m=+61.702066781" Jun 07 09:09:19.578042 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:19.577978 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" podStartSLOduration=2.201628492 podStartE2EDuration="7.577962482s" totalImagesPullingTime="5.37633399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:09:19.577700392 +0000 UTC m=+61.714570473" watchObservedRunningTime="2026-06-07 09:09:19.577962482 +0000 UTC m=+61.714832562" Jun 07 09:09:24.016749 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.016711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:09:24.017235 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.016758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:09:24.019071 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.019044 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 09:09:24.019071 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.019069 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 09:09:24.027565 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:24.027542 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 09:09:24.027668 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:24.027612 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:10:28.027596304 +0000 UTC m=+130.164466360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : secret "metrics-daemon-secret" not found Jun 07 09:09:24.028908 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.028895 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 09:09:24.040501 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.040484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhvw\" (UniqueName: \"kubernetes.io/projected/6740493f-9e7c-420b-94f9-015f472d48de-kube-api-access-llhvw\") pod \"network-check-target-nnmmj\" (UID: \"6740493f-9e7c-420b-94f9-015f472d48de\") " pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:09:24.117714 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.117679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:09:24.120391 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.120378 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 09:09:24.129874 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.129851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb4d406-9fa8-4e9e-8e7c-09237bd4a618-original-pull-secret\") pod \"global-pull-secret-syncer-xwp9z\" (UID: \"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618\") " pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:09:24.312525 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.312452 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwp9z" Jun 07 09:09:24.319813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.319789 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99ths\"" Jun 07 09:09:24.327507 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.327484 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:09:24.436448 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.436419 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwp9z"] Jun 07 09:09:24.440065 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:09:24.440039 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb4d406_9fa8_4e9e_8e7c_09237bd4a618.slice/crio-14ee3094348a5dc55731af59748800d57194f51d823720afa48ad93812354506 WatchSource:0}: Error finding container 14ee3094348a5dc55731af59748800d57194f51d823720afa48ad93812354506: Status 404 returned error can't find the container with id 14ee3094348a5dc55731af59748800d57194f51d823720afa48ad93812354506 Jun 07 09:09:24.451047 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.451025 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnmmj"] Jun 07 09:09:24.454305 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:09:24.454282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6740493f_9e7c_420b_94f9_015f472d48de.slice/crio-3e74f748c7353f80ca0f00c8b925f41284446c8eb67ab5f8e558e1fb5d90311b WatchSource:0}: Error finding container 3e74f748c7353f80ca0f00c8b925f41284446c8eb67ab5f8e558e1fb5d90311b: Status 404 returned error can't find the container with id 3e74f748c7353f80ca0f00c8b925f41284446c8eb67ab5f8e558e1fb5d90311b Jun 07 09:09:24.562581 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.562515 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnmmj" event={"ID":"6740493f-9e7c-420b-94f9-015f472d48de","Type":"ContainerStarted","Data":"3e74f748c7353f80ca0f00c8b925f41284446c8eb67ab5f8e558e1fb5d90311b"} Jun 07 09:09:24.563569 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:24.563542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwp9z" event={"ID":"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618","Type":"ContainerStarted","Data":"14ee3094348a5dc55731af59748800d57194f51d823720afa48ad93812354506"} Jun 07 09:09:25.629270 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:25.629235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:09:25.629713 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:25.629372 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:09:25.629713 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:25.629449 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:09:57.629426399 +0000 UTC m=+99.766296459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:09:29.578973 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:29.578931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnmmj" event={"ID":"6740493f-9e7c-420b-94f9-015f472d48de","Type":"ContainerStarted","Data":"ed86e06e16d7cb602bde710d210d5fcc58f05543c5b42baf08098a47ab063a25"} Jun 07 09:09:29.579422 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:29.579100 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:09:29.580309 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:29.580282 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwp9z" event={"ID":"2bb4d406-9fa8-4e9e-8e7c-09237bd4a618","Type":"ContainerStarted","Data":"681ad152f101980b2f881c115a689130d1796a80a11f358205b1f4a3ac5bfb6a"} Jun 07 09:09:29.594082 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:29.594034 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nnmmj" podStartSLOduration=67.39781994 podStartE2EDuration="1m11.5940193s" totalImagesPullingTime="4.19619936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:09:29.593630201 +0000 UTC m=+71.730500281" watchObservedRunningTime="2026-06-07 09:09:29.5940193 +0000 UTC m=+71.730889380" Jun 07 09:09:29.605988 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:29.605945 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xwp9z" podStartSLOduration=67.392240763 podStartE2EDuration="1m11.605929293s" totalImagesPullingTime="4.21368853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:09:29.605616955 +0000 UTC m=+71.742487034" watchObservedRunningTime="2026-06-07 09:09:29.605929293 +0000 UTC m=+71.742799372" Jun 07 09:09:57.651017 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:09:57.650980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:09:57.651461 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:57.651097 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:09:57.651461 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:09:57.651167 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:11:01.651152779 +0000 UTC m=+163.788022836 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:10:00.585700 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:10:00.585671 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nnmmj" Jun 07 09:10:28.058060 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:10:28.058025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:10:28.058548 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:10:28.058134 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 09:10:28.058548 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:10:28.058193 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs podName:c3d060d6-7deb-42f9-afc5-95a1a7d835ae nodeName:}" failed. No retries permitted until 2026-06-07 09:12:30.058178557 +0000 UTC m=+252.195048614 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs") pod "network-metrics-daemon-n9bfz" (UID: "c3d060d6-7deb-42f9-afc5-95a1a7d835ae") : secret "metrics-daemon-secret" not found Jun 07 09:10:56.754459 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:10:56.754427 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vvqmb" podUID="ad605592-d021-490f-923d-c82b69d08d5d" Jun 07 09:10:56.819710 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:10:56.819683 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:10:57.307425 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:10:57.307377 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n9bfz" podUID="c3d060d6-7deb-42f9-afc5-95a1a7d835ae" Jun 07 09:11:01.675406 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:01.675277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:11:01.675406 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:11:01.675394 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 09:11:01.675886 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:11:01.675455 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls podName:ad605592-d021-490f-923d-c82b69d08d5d nodeName:}" failed. No retries permitted until 2026-06-07 09:13:03.675435583 +0000 UTC m=+285.812305641 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls") pod "dns-default-vvqmb" (UID: "ad605592-d021-490f-923d-c82b69d08d5d") : secret "dns-default-metrics-tls" not found Jun 07 09:11:12.299628 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:12.299600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:11:19.551735 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:19.551684 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" podUID="998e5418-0467-4dba-ad25-46e699d0733c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 07 09:11:19.882615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:19.882539 2573 generic.go:356] "Generic (PLEG): container finished" podID="998e5418-0467-4dba-ad25-46e699d0733c" containerID="e4ca2bde1a1d70319e30b4e2aeb1e4a46ecd20c884337eaf0fcd853fbdfc0e95" exitCode=1 Jun 07 09:11:19.882615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:19.882603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" event={"ID":"998e5418-0467-4dba-ad25-46e699d0733c","Type":"ContainerDied","Data":"e4ca2bde1a1d70319e30b4e2aeb1e4a46ecd20c884337eaf0fcd853fbdfc0e95"} Jun 07 09:11:19.882976 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:19.882957 2573 scope.go:117] "RemoveContainer" containerID="e4ca2bde1a1d70319e30b4e2aeb1e4a46ecd20c884337eaf0fcd853fbdfc0e95" Jun 07 09:11:20.887046 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:20.887015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" event={"ID":"998e5418-0467-4dba-ad25-46e699d0733c","Type":"ContainerStarted","Data":"c6277036591d58641ab1bb6d785bd38ec61b84cc6ee46ea11ed9e2bba1db7957"} Jun 07 09:11:20.887441 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:20.887301 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:11:20.887876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:20.887853 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f845c6648-dpzdf" Jun 07 09:11:33.823993 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:33.823966 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f4x4t_6ad85837-4cce-431b-bd65-91545c75bed8/dns-node-resolver/0.log" Jun 07 09:11:35.025642 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:35.025617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x29gk_b3f8936d-8b23-47cb-9c6e-3e5e9d02f849/node-ca/0.log" Jun 07 09:11:35.623851 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:35.623829 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r69v_ae78a710-9da2-48a9-96bc-f9c2a7e6a708/serve-healthcheck-canary/0.log" Jun 07 09:11:54.203759 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.203724 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tk48s"] Jun 07 09:11:54.206655 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.206637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.208405 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.208387 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 09:11:54.208922 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.208897 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 09:11:54.209039 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.208922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lk99w\"" Jun 07 09:11:54.209039 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.208922 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 09:11:54.209039 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.208923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 09:11:54.215275 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.215253 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tk48s"] Jun 07 09:11:54.332981 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.332947 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-crio-socket\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.333142 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.332989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.333142 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.333014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.333142 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.333087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-data-volume\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.333142 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.333116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblmz\" (UniqueName: \"kubernetes.io/projected/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-api-access-hblmz\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434007 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.433973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-data-volume\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434007 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hblmz\" (UniqueName: \"kubernetes.io/projected/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-api-access-hblmz\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434249 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-crio-socket\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434249 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-crio-socket\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-data-volume\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.434728 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.434706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.436594 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.436577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.441192 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.441170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblmz\" (UniqueName: \"kubernetes.io/projected/0d8d7495-d4bd-4d8d-9f28-18fac91c42c2-kube-api-access-hblmz\") pod \"insights-runtime-extractor-tk48s\" (UID: \"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2\") " pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.515105 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.515030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tk48s" Jun 07 09:11:54.636537 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.636501 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tk48s"] Jun 07 09:11:54.640916 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:11:54.640891 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8d7495_d4bd_4d8d_9f28_18fac91c42c2.slice/crio-4350f98cf3f4f540d1eb27ce577b022cb4ea8a44de547cabca4b317c479cf16a WatchSource:0}: Error finding container 4350f98cf3f4f540d1eb27ce577b022cb4ea8a44de547cabca4b317c479cf16a: Status 404 returned error can't find the container with id 4350f98cf3f4f540d1eb27ce577b022cb4ea8a44de547cabca4b317c479cf16a Jun 07 09:11:54.979097 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.979057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tk48s" event={"ID":"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2","Type":"ContainerStarted","Data":"04e7982c242569a4945f8728b7fcf07aaadcb2ca75203ba2720809445f1f4ccc"} Jun 07 09:11:54.979268 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:54.979112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tk48s" event={"ID":"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2","Type":"ContainerStarted","Data":"4350f98cf3f4f540d1eb27ce577b022cb4ea8a44de547cabca4b317c479cf16a"} Jun 07 09:11:55.983864 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:55.983825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tk48s" event={"ID":"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2","Type":"ContainerStarted","Data":"3df7c18f9800974354c5f154544c6c1dd01d8bbbcdc198f79ee361fce11f3dd9"} Jun 07 09:11:56.988595 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:56.988562 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tk48s" event={"ID":"0d8d7495-d4bd-4d8d-9f28-18fac91c42c2","Type":"ContainerStarted","Data":"5ad9481c75291e70a19d9717d50ac5b7d9ee45e02879fa03b19d9033154f3498"} Jun 07 09:11:57.003916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:11:57.003872 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tk48s" podStartSLOduration=0.942734774 podStartE2EDuration="3.00385738s" totalImagesPullingTime="2.061122606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:11:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:11:57.002908986 +0000 UTC m=+219.139779066" watchObservedRunningTime="2026-06-07 09:11:57.00385738 +0000 UTC m=+219.140727477" Jun 07 09:12:02.161777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.161743 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k"] Jun 07 09:12:02.164572 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.164557 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:02.166163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.166140 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 07 09:12:02.166285 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.166178 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7dx5p\"" Jun 07 09:12:02.173215 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.173192 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k"] Jun 07 09:12:02.291521 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.291476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af4bac35-f322-4943-ac98-6d3e391262bf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mmf5k\" (UID: \"af4bac35-f322-4943-ac98-6d3e391262bf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:02.392109 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.392071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af4bac35-f322-4943-ac98-6d3e391262bf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mmf5k\" (UID: \"af4bac35-f322-4943-ac98-6d3e391262bf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:02.394448 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.394429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/af4bac35-f322-4943-ac98-6d3e391262bf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-mmf5k\" (UID: \"af4bac35-f322-4943-ac98-6d3e391262bf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:02.472860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.472825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:02.592223 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:02.592178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k"] Jun 07 09:12:02.596123 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:02.596100 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4bac35_f322_4943_ac98_6d3e391262bf.slice/crio-dc208461ea1065771c7e6f42ecb8cc9f3cc415f98a2d5b5678d3fbcf84933bfc WatchSource:0}: Error finding container dc208461ea1065771c7e6f42ecb8cc9f3cc415f98a2d5b5678d3fbcf84933bfc: Status 404 returned error can't find the container with id dc208461ea1065771c7e6f42ecb8cc9f3cc415f98a2d5b5678d3fbcf84933bfc Jun 07 09:12:03.007841 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.007809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" event={"ID":"af4bac35-f322-4943-ac98-6d3e391262bf","Type":"ContainerStarted","Data":"dc208461ea1065771c7e6f42ecb8cc9f3cc415f98a2d5b5678d3fbcf84933bfc"} Jun 07 09:12:03.311467 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.311370 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" podUID="dcdb2dba-9dd0-4849-ac7e-34622b71ad41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 09:12:03.930707 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.930676 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:03.933626 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.933608 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:03.935251 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935229 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 09:12:03.935900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935877 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 09:12:03.935999 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935900 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 09:12:03.935999 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935900 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 09:12:03.935999 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935962 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 09:12:03.935999 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.935878 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 09:12:03.936224 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.936207 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 09:12:03.936276 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.936251 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k2swh\"" Jun 07 09:12:03.943710 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:03.943690 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:04.001550 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.001550 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6ld\" (UniqueName: \"kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.001750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.001750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.001750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.001750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.001695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.011706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.011680 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" event={"ID":"af4bac35-f322-4943-ac98-6d3e391262bf","Type":"ContainerStarted","Data":"f44062f26bb0b71de823d8adb7efee408d1d64e383600b5d01c5e3b5d558a5ae"} Jun 07 09:12:04.011905 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.011884 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:04.016386 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.016367 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" Jun 07 09:12:04.025501 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.025462 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-mmf5k" podStartSLOduration=1.069254871 podStartE2EDuration="2.025448287s" totalImagesPullingTime="956.193416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:04.024359892 +0000 UTC m=+226.161229967" watchObservedRunningTime="2026-06-07 09:12:04.025448287 +0000 UTC m=+226.162318521" Jun 07 09:12:04.102371 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6ld\" (UniqueName: \"kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.102371 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.102612 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.102612 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.102713 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.102788 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.102771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.103070 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.103047 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.103365 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.103317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.103365 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.103360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.105269 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.105249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.105370 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.105288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.109399 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.109371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6ld\" (UniqueName: \"kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld\") pod \"console-66f6f8b55b-9762c\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.242936 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.242839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:04.369986 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:04.369950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:04.373147 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:04.373123 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf5b09_0761_499a_9aad_58ecbab05de8.slice/crio-a712aa74e06c425a8dd22d6bd817c325b36c21b573567f19c56f9048529e935b WatchSource:0}: Error finding container a712aa74e06c425a8dd22d6bd817c325b36c21b573567f19c56f9048529e935b: Status 404 returned error can't find the container with id a712aa74e06c425a8dd22d6bd817c325b36c21b573567f19c56f9048529e935b Jun 07 09:12:05.015445 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:05.015412 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6f8b55b-9762c" event={"ID":"5aaf5b09-0761-499a-9aad-58ecbab05de8","Type":"ContainerStarted","Data":"a712aa74e06c425a8dd22d6bd817c325b36c21b573567f19c56f9048529e935b"} Jun 07 09:12:08.027138 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.027106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6f8b55b-9762c" event={"ID":"5aaf5b09-0761-499a-9aad-58ecbab05de8","Type":"ContainerStarted","Data":"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252"} Jun 07 09:12:08.042493 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.042441 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f6f8b55b-9762c" podStartSLOduration=2.128850206 podStartE2EDuration="5.042425567s" totalImagesPullingTime="2.913575361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:08.041796193 +0000 UTC m=+230.178666271" watchObservedRunningTime="2026-06-07 09:12:08.042425567 +0000 UTC m=+230.179295647" Jun 07 09:12:08.595751 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.595717 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7828r"] Jun 07 09:12:08.599181 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.599158 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.601298 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601277 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 09:12:08.601423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601367 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 09:12:08.601423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601382 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 09:12:08.601528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601434 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 09:12:08.601935 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601921 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 09:12:08.601979 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.601940 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pc6hm\"" Jun 07 09:12:08.602395 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.602380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 09:12:08.740826 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.740787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-metrics-client-ca\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741020 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.740848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-sys\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741020 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.740911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741020 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.740970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-root\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741020 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.740997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741195 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.741023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvq9r\" (UniqueName: \"kubernetes.io/projected/ab23b030-b022-47aa-95f8-f2f86943a9e1-kube-api-access-bvq9r\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741195 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.741051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-textfile\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741195 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.741093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-wtmp\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.741195 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.741121 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.841836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-sys\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.841836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-root\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvq9r\" (UniqueName: \"kubernetes.io/projected/ab23b030-b022-47aa-95f8-f2f86943a9e1-kube-api-access-bvq9r\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-sys\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841921 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-textfile\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-wtmp\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.841969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-root\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-metrics-client-ca\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842056 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:08.842053 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 09:12:08.842494 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:08.842123 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls podName:ab23b030-b022-47aa-95f8-f2f86943a9e1 nodeName:}" failed. No retries permitted until 2026-06-07 09:12:09.342101832 +0000 UTC m=+231.478971911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls") pod "node-exporter-7828r" (UID: "ab23b030-b022-47aa-95f8-f2f86943a9e1") : secret "node-exporter-tls" not found Jun 07 09:12:08.842494 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842160 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-wtmp\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842494 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-textfile\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842597 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-metrics-client-ca\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.842597 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.842577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.844236 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.844219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:08.851645 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:08.851592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvq9r\" (UniqueName: \"kubernetes.io/projected/ab23b030-b022-47aa-95f8-f2f86943a9e1-kube-api-access-bvq9r\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:09.345752 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.345718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:09.347871 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.347853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab23b030-b022-47aa-95f8-f2f86943a9e1-node-exporter-tls\") pod \"node-exporter-7828r\" (UID: \"ab23b030-b022-47aa-95f8-f2f86943a9e1\") " pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:09.508831 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.508796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7828r" Jun 07 09:12:09.519779 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:09.519748 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab23b030_b022_47aa_95f8_f2f86943a9e1.slice/crio-369f4712d9578d73926c531e824042e9f5a4f14153c3cb629bcf55cbaadea9e3 WatchSource:0}: Error finding container 369f4712d9578d73926c531e824042e9f5a4f14153c3cb629bcf55cbaadea9e3: Status 404 returned error can't find the container with id 369f4712d9578d73926c531e824042e9f5a4f14153c3cb629bcf55cbaadea9e3 Jun 07 09:12:09.646895 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.646823 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:12:09.651259 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.651244 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.653155 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653138 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 07 09:12:09.653413 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653395 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 07 09:12:09.653524 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653507 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 07 09:12:09.653684 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 07 09:12:09.653775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653732 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 07 09:12:09.653892 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653872 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 07 09:12:09.653981 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 07 09:12:09.653981 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653930 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mnlbj\"" Jun 07 09:12:09.653981 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.653937 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 07 09:12:09.654261 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.654248 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 07 09:12:09.665975 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.665956 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:12:09.749968 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.749939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.749976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85bv\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750247 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750575 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.750575 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.750407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851704 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85bv\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.851861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.851967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.852001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.852026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852117 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.852058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852466 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:09.852175 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 07 09:12:09.852466 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:09.852233 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls podName:56d5ca08-1ade-46a2-b94a-d4ab252b975b nodeName:}" failed. No retries permitted until 2026-06-07 09:12:10.352213541 +0000 UTC m=+232.489083609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b") : secret "alertmanager-main-tls" not found Jun 07 09:12:09.852466 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.852274 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.852791 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.852768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.853363 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.853317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.854682 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.854658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.854956 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.854930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.855065 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.854985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.855065 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.855013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.855517 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.855486 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.855604 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.855584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.855816 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.855798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.856018 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.856000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:09.859567 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:09.859548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85bv\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:10.034822 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:10.034790 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7828r" event={"ID":"ab23b030-b022-47aa-95f8-f2f86943a9e1","Type":"ContainerStarted","Data":"369f4712d9578d73926c531e824042e9f5a4f14153c3cb629bcf55cbaadea9e3"} Jun 07 09:12:10.357284 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:10.357217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:10.359397 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:10.359370 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:10.561019 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:10.560989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:12:10.694551 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:10.694519 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:12:10.697792 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:10.697749 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d5ca08_1ade_46a2_b94a_d4ab252b975b.slice/crio-84c8758f9fc616a0b72ff83562264f8fb69cad701314596f4389bb3b213fbfc3 WatchSource:0}: Error finding container 84c8758f9fc616a0b72ff83562264f8fb69cad701314596f4389bb3b213fbfc3: Status 404 returned error can't find the container with id 84c8758f9fc616a0b72ff83562264f8fb69cad701314596f4389bb3b213fbfc3 Jun 07 09:12:11.039677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:11.039636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"84c8758f9fc616a0b72ff83562264f8fb69cad701314596f4389bb3b213fbfc3"} Jun 07 09:12:11.041082 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:11.041054 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab23b030-b022-47aa-95f8-f2f86943a9e1" containerID="1c7a7ce1b0eab8c36dafe85b3b1c10abb272b7507784f2992477f6a88b239c2a" exitCode=0 Jun 07 09:12:11.041194 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:11.041101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7828r" event={"ID":"ab23b030-b022-47aa-95f8-f2f86943a9e1","Type":"ContainerDied","Data":"1c7a7ce1b0eab8c36dafe85b3b1c10abb272b7507784f2992477f6a88b239c2a"} Jun 07 09:12:12.052528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:12.052441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7828r" event={"ID":"ab23b030-b022-47aa-95f8-f2f86943a9e1","Type":"ContainerStarted","Data":"038c673edb434f6702fa0c63d8f3432f37e8f0dc91b83b880b4ed7fab5b00d9b"} Jun 07 09:12:12.052929 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:12.052528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7828r" event={"ID":"ab23b030-b022-47aa-95f8-f2f86943a9e1","Type":"ContainerStarted","Data":"441db5c434ff6aaf9099e2910023ef7b0cf2060e1384a763688d75aeab04eaf4"} Jun 07 09:12:12.053926 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:12.053907 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6" exitCode=0 Jun 07 09:12:12.053997 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:12.053937 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6"} Jun 07 09:12:12.068209 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:12.068157 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7828r" podStartSLOduration=3.134110598 podStartE2EDuration="4.068143131s" totalImagesPullingTime="871.890104ms" totalInitContainerRuntime="62.142429ms" isStatefulPod=true podCreationTimestamp="2026-06-07 09:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:12.067841599 +0000 UTC m=+234.204711716" watchObservedRunningTime="2026-06-07 09:12:12.068143131 +0000 UTC m=+234.205013214" Jun 07 09:12:13.310878 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.310849 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" podUID="dcdb2dba-9dd0-4849-ac7e-34622b71ad41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 09:12:13.394494 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.394463 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:13.429983 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.429954 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:12:13.434359 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.434341 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.440131 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.440110 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 09:12:13.442965 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.442941 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:12:13.586555 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586645 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5jb\" (UniqueName: \"kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586645 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586721 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586754 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586798 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.586798 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.586787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688125 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688259 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688259 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688189 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688259 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688259 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5jb\" (UniqueName: \"kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688959 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.688959 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.689112 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.688969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.689146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.689128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.690717 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.690693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.690806 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.690734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.696004 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.695983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5jb\" (UniqueName: \"kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb\") pod \"console-5bb67b7d96-zgrd9\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.764481 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.764459 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:13.811172 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.810602 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b467d8fd8-8q82d"] Jun 07 09:12:13.814588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.814565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.816934 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.816970 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.817029 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.817249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kh26d\"" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.817262 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 07 09:12:13.817583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.817480 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 07 09:12:13.827936 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.827905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b467d8fd8-8q82d"] Jun 07 09:12:13.833291 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.833071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 07 09:12:13.894681 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.894648 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:12:13.898084 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:13.898056 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a7d8e2_b711_4552_a051_0426e04a6bc2.slice/crio-7e3fba54888418218f9bcc6dbccdd583fb5276c74771dfa9e03a139a9f2bfb5d WatchSource:0}: Error finding container 7e3fba54888418218f9bcc6dbccdd583fb5276c74771dfa9e03a139a9f2bfb5d: Status 404 returned error can't find the container with id 7e3fba54888418218f9bcc6dbccdd583fb5276c74771dfa9e03a139a9f2bfb5d Jun 07 09:12:13.992086 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992222 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-federate-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992222 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992222 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-serving-certs-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992352 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992352 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992352 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzpcv\" (UniqueName: \"kubernetes.io/projected/c2d0fc38-a2df-454e-bd1c-afa816367099-kube-api-access-lzpcv\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:13.992491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:13.992414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-metrics-client-ca\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.063418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.063345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4"} Jun 07 09:12:14.063418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.063408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4"} Jun 07 09:12:14.063598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.063445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2"} Jun 07 09:12:14.063598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.063472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b"} Jun 07 09:12:14.063598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.063556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b"} Jun 07 09:12:14.064689 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.064667 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb67b7d96-zgrd9" event={"ID":"d1a7d8e2-b711-4552-a051-0426e04a6bc2","Type":"ContainerStarted","Data":"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b"} Jun 07 09:12:14.064792 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.064703 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb67b7d96-zgrd9" event={"ID":"d1a7d8e2-b711-4552-a051-0426e04a6bc2","Type":"ContainerStarted","Data":"7e3fba54888418218f9bcc6dbccdd583fb5276c74771dfa9e03a139a9f2bfb5d"} Jun 07 09:12:14.080172 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.080129 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bb67b7d96-zgrd9" podStartSLOduration=1.0801146 podStartE2EDuration="1.0801146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:14.078771143 +0000 UTC m=+236.215641233" watchObservedRunningTime="2026-06-07 09:12:14.0801146 +0000 UTC m=+236.216984679" Jun 07 09:12:14.093495 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-serving-certs-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093576 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093576 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093576 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzpcv\" (UniqueName: \"kubernetes.io/projected/c2d0fc38-a2df-454e-bd1c-afa816367099-kube-api-access-lzpcv\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-metrics-client-ca\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-federate-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.093706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.093664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.094309 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.094283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-metrics-client-ca\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.094423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.094306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-serving-certs-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.094670 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.094649 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.096087 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.096059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-telemeter-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.096163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.096133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.096573 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.096552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-federate-client-tls\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.096608 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.096558 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d0fc38-a2df-454e-bd1c-afa816367099-secret-telemeter-client\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.100553 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.100534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzpcv\" (UniqueName: \"kubernetes.io/projected/c2d0fc38-a2df-454e-bd1c-afa816367099-kube-api-access-lzpcv\") pod \"telemeter-client-b467d8fd8-8q82d\" (UID: \"c2d0fc38-a2df-454e-bd1c-afa816367099\") " pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.133761 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.133740 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" Jun 07 09:12:14.242996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.242967 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:14.273656 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:14.273626 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b467d8fd8-8q82d"] Jun 07 09:12:14.373682 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:14.373605 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d0fc38_a2df_454e_bd1c_afa816367099.slice/crio-a07a8c13a477a806e97ff75ed4d98a5415b15fafc14d7422007be291fe50c60f WatchSource:0}: Error finding container a07a8c13a477a806e97ff75ed4d98a5415b15fafc14d7422007be291fe50c60f: Status 404 returned error can't find the container with id a07a8c13a477a806e97ff75ed4d98a5415b15fafc14d7422007be291fe50c60f Jun 07 09:12:15.068725 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:15.068687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" event={"ID":"c2d0fc38-a2df-454e-bd1c-afa816367099","Type":"ContainerStarted","Data":"a07a8c13a477a806e97ff75ed4d98a5415b15fafc14d7422007be291fe50c60f"} Jun 07 09:12:15.071502 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:15.071460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerStarted","Data":"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1"} Jun 07 09:12:15.094213 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:15.094175 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.934292199 podStartE2EDuration="6.094161286s" totalImagesPullingTime="3.141888916s" totalInitContainerRuntime="17.980171ms" isStatefulPod=false podCreationTimestamp="2026-06-07 09:12:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:15.092755112 +0000 UTC m=+237.229625193" watchObservedRunningTime="2026-06-07 09:12:15.094161286 +0000 UTC m=+237.231031367" Jun 07 09:12:17.084895 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:17.084858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" event={"ID":"c2d0fc38-a2df-454e-bd1c-afa816367099","Type":"ContainerStarted","Data":"00030149fceb87abb5d4841bbd3c9aafc02106457182a28b7c21c6105cc0feaa"} Jun 07 09:12:17.085243 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:17.084918 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" event={"ID":"c2d0fc38-a2df-454e-bd1c-afa816367099","Type":"ContainerStarted","Data":"2dd0042d65e94300b5bdbc6a23acf6eca278d441faa672fd37cdd62fe32a4cdd"} Jun 07 09:12:17.085243 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:17.084938 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" event={"ID":"c2d0fc38-a2df-454e-bd1c-afa816367099","Type":"ContainerStarted","Data":"603a01c35409af535715a47c4d9926cedc2b2d62cea9e08703dd4eb52bc4e69f"} Jun 07 09:12:17.105258 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:17.105204 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b467d8fd8-8q82d" podStartSLOduration=2.084887001 podStartE2EDuration="4.105191149s" totalImagesPullingTime="2.020304148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:17.103111365 +0000 UTC m=+239.239981443" watchObservedRunningTime="2026-06-07 09:12:17.105191149 +0000 UTC m=+239.242061247" Jun 07 09:12:23.311866 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.311828 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" podUID="dcdb2dba-9dd0-4849-ac7e-34622b71ad41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 09:12:23.312300 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.311892 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" Jun 07 09:12:23.312367 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.312342 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0c6e483ec75c4ff7195231b47e3b7a43178de0dc16eaf6df427c298deba40f6d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 07 09:12:23.312428 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.312390 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" podUID="dcdb2dba-9dd0-4849-ac7e-34622b71ad41" containerName="service-proxy" containerID="cri-o://0c6e483ec75c4ff7195231b47e3b7a43178de0dc16eaf6df427c298deba40f6d" gracePeriod=30 Jun 07 09:12:23.765075 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.765042 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:23.765288 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.765096 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:12:23.766202 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.766178 2573 patch_prober.go:28] interesting pod/console-5bb67b7d96-zgrd9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 07 09:12:23.766300 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:23.766217 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 07 09:12:24.109545 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:24.109461 2573 generic.go:356] "Generic (PLEG): container finished" podID="dcdb2dba-9dd0-4849-ac7e-34622b71ad41" containerID="0c6e483ec75c4ff7195231b47e3b7a43178de0dc16eaf6df427c298deba40f6d" exitCode=2 Jun 07 09:12:24.109687 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:24.109539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerDied","Data":"0c6e483ec75c4ff7195231b47e3b7a43178de0dc16eaf6df427c298deba40f6d"} Jun 07 09:12:24.109687 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:24.109593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-698dcb769c-gq4sv" event={"ID":"dcdb2dba-9dd0-4849-ac7e-34622b71ad41","Type":"ContainerStarted","Data":"6dd6bcc7bb73b8c890e147159efa433f88655ffbefb03449b6d72240460ab8ad"} Jun 07 09:12:30.120659 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:30.120619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:12:30.122899 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:30.122875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d060d6-7deb-42f9-afc5-95a1a7d835ae-metrics-certs\") pod \"network-metrics-daemon-n9bfz\" (UID: \"c3d060d6-7deb-42f9-afc5-95a1a7d835ae\") " pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:12:30.302118 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:30.302091 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jh2fl\"" Jun 07 09:12:30.310670 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:30.310656 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9bfz" Jun 07 09:12:30.429106 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:30.429077 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n9bfz"] Jun 07 09:12:30.432842 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:12:30.432819 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d060d6_7deb_42f9_afc5_95a1a7d835ae.slice/crio-6862351e5770810fe25c4832878549b777ae614ce54eacc2208fffda98b8e00a WatchSource:0}: Error finding container 6862351e5770810fe25c4832878549b777ae614ce54eacc2208fffda98b8e00a: Status 404 returned error can't find the container with id 6862351e5770810fe25c4832878549b777ae614ce54eacc2208fffda98b8e00a Jun 07 09:12:31.141135 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:31.141089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9bfz" event={"ID":"c3d060d6-7deb-42f9-afc5-95a1a7d835ae","Type":"ContainerStarted","Data":"6862351e5770810fe25c4832878549b777ae614ce54eacc2208fffda98b8e00a"} Jun 07 09:12:32.146411 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:32.146373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9bfz" event={"ID":"c3d060d6-7deb-42f9-afc5-95a1a7d835ae","Type":"ContainerStarted","Data":"16316d7eef3282e02ab7c24d7cc6ed77a7d01e331494cb2a2a6216de10f4ca2d"} Jun 07 09:12:32.146836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:32.146452 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9bfz" event={"ID":"c3d060d6-7deb-42f9-afc5-95a1a7d835ae","Type":"ContainerStarted","Data":"321641686d5a3a323a7f2d58d8e83d615b5160024a4e8124a1acd695e5d1b321"} Jun 07 09:12:32.160797 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:32.160748 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n9bfz" podStartSLOduration=253.314700802 podStartE2EDuration="4m14.160734503s" totalImagesPullingTime="846.033701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:12:32.1598259 +0000 UTC m=+254.296695976" watchObservedRunningTime="2026-06-07 09:12:32.160734503 +0000 UTC m=+254.297604618" Jun 07 09:12:33.765004 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:33.764973 2573 patch_prober.go:28] interesting pod/console-5bb67b7d96-zgrd9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 07 09:12:33.765356 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:33.765027 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 07 09:12:38.413999 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:38.413970 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66f6f8b55b-9762c" podUID="5aaf5b09-0761-499a-9aad-58ecbab05de8" containerName="console" containerID="cri-o://483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252" gracePeriod=15 Jun 07 09:12:43.765148 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:43.765110 2573 patch_prober.go:28] interesting pod/console-5bb67b7d96-zgrd9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 07 09:12:43.765553 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:43.765165 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 07 09:12:53.765498 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:53.765462 2573 patch_prober.go:28] interesting pod/console-5bb67b7d96-zgrd9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 07 09:12:53.765853 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:53.765543 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 07 09:12:54.047837 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.047814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66f6f8b55b-9762c_5aaf5b09-0761-499a-9aad-58ecbab05de8/console/0.log" Jun 07 09:12:54.050395 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.050362 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:54.094364 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094343 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6ld\" (UniqueName: \"kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094479 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094372 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094479 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094394 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094575 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094521 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094575 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094548 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094681 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094585 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config\") pod \"5aaf5b09-0761-499a-9aad-58ecbab05de8\" (UID: \"5aaf5b09-0761-499a-9aad-58ecbab05de8\") " Jun 07 09:12:54.094857 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094834 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:12:54.094920 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094756 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca" (OuterVolumeSpecName: "service-ca") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:12:54.094981 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.094922 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config" (OuterVolumeSpecName: "console-config") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:12:54.096700 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.096671 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld" (OuterVolumeSpecName: "kube-api-access-zt6ld") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "kube-api-access-zt6ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:12:54.096783 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.096672 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:12:54.096783 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.096711 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5aaf5b09-0761-499a-9aad-58ecbab05de8" (UID: "5aaf5b09-0761-499a-9aad-58ecbab05de8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:12:54.195768 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195744 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-serving-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.195768 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195765 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.195900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195774 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aaf5b09-0761-499a-9aad-58ecbab05de8-console-oauth-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.195900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195783 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt6ld\" (UniqueName: \"kubernetes.io/projected/5aaf5b09-0761-499a-9aad-58ecbab05de8-kube-api-access-zt6ld\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.195900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195793 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-oauth-serving-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.195900 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.195801 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aaf5b09-0761-499a-9aad-58ecbab05de8-service-ca\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:12:54.222911 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.222891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66f6f8b55b-9762c_5aaf5b09-0761-499a-9aad-58ecbab05de8/console/0.log" Jun 07 09:12:54.222996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.222928 2573 generic.go:356] "Generic (PLEG): container finished" podID="5aaf5b09-0761-499a-9aad-58ecbab05de8" containerID="483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252" exitCode=137 Jun 07 09:12:54.222996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.222957 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6f8b55b-9762c" event={"ID":"5aaf5b09-0761-499a-9aad-58ecbab05de8","Type":"ContainerDied","Data":"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252"} Jun 07 09:12:54.222996 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.222982 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6f8b55b-9762c" Jun 07 09:12:54.223089 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.223009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6f8b55b-9762c" event={"ID":"5aaf5b09-0761-499a-9aad-58ecbab05de8","Type":"ContainerDied","Data":"a712aa74e06c425a8dd22d6bd817c325b36c21b573567f19c56f9048529e935b"} Jun 07 09:12:54.223089 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.223042 2573 scope.go:117] "RemoveContainer" containerID="483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252" Jun 07 09:12:54.231757 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.231738 2573 scope.go:117] "RemoveContainer" containerID="483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252" Jun 07 09:12:54.232003 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:54.231982 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252\": container with ID starting with 483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252 not found: ID does not exist" containerID="483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252" Jun 07 09:12:54.232066 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.232014 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252"} err="failed to get container status \"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252\": rpc error: code = NotFound desc = could not find container \"483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252\": container with ID starting with 483e99c067a0bab2d28a76de1adf71a5a5bba6543244a1b89e1bc32f6a4c2252 not found: ID does not exist" Jun 07 09:12:54.241870 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.241851 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:54.245539 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.245520 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f6f8b55b-9762c"] Jun 07 09:12:54.300925 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:12:54.300876 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aaf5b09-0761-499a-9aad-58ecbab05de8" path="/var/lib/kubelet/pods/5aaf5b09-0761-499a-9aad-58ecbab05de8/volumes" Jun 07 09:12:59.820309 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:12:59.820257 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vvqmb" podUID="ad605592-d021-490f-923d-c82b69d08d5d" Jun 07 09:13:00.246069 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:00.246041 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:03.759265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.759235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:03.761594 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.761570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad605592-d021-490f-923d-c82b69d08d5d-metrics-tls\") pod \"dns-default-vvqmb\" (UID: \"ad605592-d021-490f-923d-c82b69d08d5d\") " pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:03.765649 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.765617 2573 patch_prober.go:28] interesting pod/console-5bb67b7d96-zgrd9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 07 09:13:03.765771 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.765668 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 07 09:13:03.848562 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.848534 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmvt5\"" Jun 07 09:13:03.857864 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.857847 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:03.978917 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:03.978894 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvqmb"] Jun 07 09:13:03.981104 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:13:03.981076 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad605592_d021_490f_923d_c82b69d08d5d.slice/crio-a8125a48bb70f101c8ebc7489c2271cc04b708a58e0697e3d2c963ad01af31e0 WatchSource:0}: Error finding container a8125a48bb70f101c8ebc7489c2271cc04b708a58e0697e3d2c963ad01af31e0: Status 404 returned error can't find the container with id a8125a48bb70f101c8ebc7489c2271cc04b708a58e0697e3d2c963ad01af31e0 Jun 07 09:13:04.260803 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:04.260769 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvqmb" event={"ID":"ad605592-d021-490f-923d-c82b69d08d5d","Type":"ContainerStarted","Data":"a8125a48bb70f101c8ebc7489c2271cc04b708a58e0697e3d2c963ad01af31e0"} Jun 07 09:13:06.270820 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:06.270792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvqmb" event={"ID":"ad605592-d021-490f-923d-c82b69d08d5d","Type":"ContainerStarted","Data":"9e4a1405ab21fa91f3604be72ab2ec5a41c5479075e8ee584defa5a00242ae58"} Jun 07 09:13:06.271198 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:06.270837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvqmb" event={"ID":"ad605592-d021-490f-923d-c82b69d08d5d","Type":"ContainerStarted","Data":"c8ed694fdb20c641099ae89451cb3d8b33feaad2d298255620712eb3eb67a182"} Jun 07 09:13:06.271198 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:06.270935 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:06.287016 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:06.286971 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vvqmb" podStartSLOduration=251.861891065 podStartE2EDuration="4m13.28695817s" totalImagesPullingTime="1.425067105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:13:06.28612827 +0000 UTC m=+288.422998373" watchObservedRunningTime="2026-06-07 09:13:06.28695817 +0000 UTC m=+288.423828276" Jun 07 09:13:13.769457 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:13.769429 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:13:13.777334 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:13.777289 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:13:16.276614 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:16.276582 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vvqmb" Jun 07 09:13:17.598268 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:17.598234 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:13:18.241102 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:18.241072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:13:18.242985 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:18.242961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:13:18.248876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:18.248860 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 09:13:28.915958 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.915660 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916033 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="alertmanager" containerID="cri-o://6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b" gracePeriod=120 Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916051 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="prom-label-proxy" containerID="cri-o://91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1" gracePeriod=120 Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916071 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-web" containerID="cri-o://eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2" gracePeriod=120 Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916105 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="config-reloader" containerID="cri-o://a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b" gracePeriod=120 Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916185 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy" containerID="cri-o://733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4" gracePeriod=120 Jun 07 09:13:28.918535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:28.916215 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-metric" containerID="cri-o://f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4" gracePeriod=120 Jun 07 09:13:29.356992 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.356966 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1" exitCode=0 Jun 07 09:13:29.356992 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.356987 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4" exitCode=0 Jun 07 09:13:29.356992 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.356996 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2" exitCode=0 Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357002 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b" exitCode=0 Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357007 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b" exitCode=0 Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357042 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1"} Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4"} Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2"} Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b"} Jun 07 09:13:29.357203 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:29.357190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b"} Jun 07 09:13:30.153914 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.153888 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.264057 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.263975 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264057 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264029 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264057 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264052 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264071 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264094 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264112 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264145 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264171 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85bv\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264203 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264249 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264278 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264311 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264311 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264784 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264387 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets\") pod \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\" (UID: \"56d5ca08-1ade-46a2-b94a-d4ab252b975b\") " Jun 07 09:13:30.264784 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264477 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:30.264784 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264632 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-metrics-client-ca\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.264784 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.264700 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:30.266729 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.266702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv" (OuterVolumeSpecName: "kube-api-access-l85bv") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "kube-api-access-l85bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:13:30.266915 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.266894 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:13:30.267019 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.266959 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.267439 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.267383 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume" (OuterVolumeSpecName: "config-volume") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.267439 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.267406 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.267593 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.267442 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.267649 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.267585 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.267941 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.267918 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out" (OuterVolumeSpecName: "config-out") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:13:30.268736 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.268712 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:13:30.270610 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.270581 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.277229 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.277208 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config" (OuterVolumeSpecName: "web-config") pod "56d5ca08-1ade-46a2-b94a-d4ab252b975b" (UID: "56d5ca08-1ade-46a2-b94a-d4ab252b975b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:30.363146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.363124 2573 generic.go:356] "Generic (PLEG): container finished" podID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerID="f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4" exitCode=0 Jun 07 09:13:30.363246 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.363184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4"} Jun 07 09:13:30.363246 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.363227 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.363246 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.363243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56d5ca08-1ade-46a2-b94a-d4ab252b975b","Type":"ContainerDied","Data":"84c8758f9fc616a0b72ff83562264f8fb69cad701314596f4389bb3b213fbfc3"} Jun 07 09:13:30.363438 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.363275 2573 scope.go:117] "RemoveContainer" containerID="91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1" Jun 07 09:13:30.365434 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365391 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-cluster-tls-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365434 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365417 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365434 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365431 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85bv\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-kube-api-access-l85bv\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365446 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-alertmanager-main-db\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365460 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-web-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365474 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365487 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365500 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56d5ca08-1ade-46a2-b94a-d4ab252b975b-tls-assets\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365512 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-out\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365525 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-main-tls\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365537 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.365615 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.365551 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56d5ca08-1ade-46a2-b94a-d4ab252b975b-config-volume\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:30.370309 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.370289 2573 scope.go:117] "RemoveContainer" containerID="f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4" Jun 07 09:13:30.376627 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.376609 2573 scope.go:117] "RemoveContainer" containerID="733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4" Jun 07 09:13:30.380292 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.380274 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:30.383882 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.383866 2573 scope.go:117] "RemoveContainer" containerID="eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2" Jun 07 09:13:30.384819 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.384804 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:30.389910 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.389894 2573 scope.go:117] "RemoveContainer" containerID="a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b" Jun 07 09:13:30.396094 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.396079 2573 scope.go:117] "RemoveContainer" containerID="6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b" Jun 07 09:13:30.402521 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.402504 2573 scope.go:117] "RemoveContainer" containerID="09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6" Jun 07 09:13:30.408739 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.408723 2573 scope.go:117] "RemoveContainer" containerID="91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1" Jun 07 09:13:30.409056 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.409031 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1\": container with ID starting with 91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1 not found: ID does not exist" containerID="91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1" Jun 07 09:13:30.409163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409069 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1"} err="failed to get container status \"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1\": rpc error: code = NotFound desc = could not find container \"91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1\": container with ID starting with 91dcca94bb741b30b0714073eaecad4db41ded0fa1962b726ec7c6704d3de1e1 not found: ID does not exist" Jun 07 09:13:30.409163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409095 2573 scope.go:117] "RemoveContainer" containerID="f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4" Jun 07 09:13:30.409610 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.409591 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4\": container with ID starting with f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4 not found: ID does not exist" containerID="f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4" Jun 07 09:13:30.409696 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409613 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4"} err="failed to get container status \"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4\": rpc error: code = NotFound desc = could not find container \"f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4\": container with ID starting with f9274734e73d2078bed2f54f6f34bc90fe7ea7b7ce56d6293daf35f2885db4a4 not found: ID does not exist" Jun 07 09:13:30.409696 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409627 2573 scope.go:117] "RemoveContainer" containerID="733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4" Jun 07 09:13:30.409860 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.409841 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4\": container with ID starting with 733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4 not found: ID does not exist" containerID="733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4" Jun 07 09:13:30.409919 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409874 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4"} err="failed to get container status \"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4\": rpc error: code = NotFound desc = could not find container \"733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4\": container with ID starting with 733a76f41f1a0b171874fa76b360034f714f2df8b52a5e62d7f23885cb782fd4 not found: ID does not exist" Jun 07 09:13:30.409919 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.409890 2573 scope.go:117] "RemoveContainer" containerID="eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2" Jun 07 09:13:30.410114 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.410097 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2\": container with ID starting with eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2 not found: ID does not exist" containerID="eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2" Jun 07 09:13:30.410168 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410118 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2"} err="failed to get container status \"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2\": rpc error: code = NotFound desc = could not find container \"eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2\": container with ID starting with eeaaffaabf6e37c7f4f5d19fe7347be93ac5a4780d77a8c9e592e337205227e2 not found: ID does not exist" Jun 07 09:13:30.410168 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410132 2573 scope.go:117] "RemoveContainer" containerID="a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b" Jun 07 09:13:30.410317 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410301 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:30.410420 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.410402 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b\": container with ID starting with a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b not found: ID does not exist" containerID="a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b" Jun 07 09:13:30.410480 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410426 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b"} err="failed to get container status \"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b\": rpc error: code = NotFound desc = could not find container \"a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b\": container with ID starting with a04e6f73b88ad2aa4e246f7f5d0d562dcf4c47401505d401d4dae2d8a696d97b not found: ID does not exist" Jun 07 09:13:30.410480 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410438 2573 scope.go:117] "RemoveContainer" containerID="6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b" Jun 07 09:13:30.410637 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410622 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-web" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.410631 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b\": container with ID starting with 6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b not found: ID does not exist" containerID="6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410641 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-web" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410655 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-metric" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410657 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b"} err="failed to get container status \"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b\": rpc error: code = NotFound desc = could not find container \"6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b\": container with ID starting with 6da3cab240098c11795d7868895e5f24d902e85ff41d158002a7a50f7ef6e84b not found: ID does not exist" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410664 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-metric" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410671 2573 scope.go:117] "RemoveContainer" containerID="09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410675 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aaf5b09-0761-499a-9aad-58ecbab05de8" containerName="console" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410686 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aaf5b09-0761-499a-9aad-58ecbab05de8" containerName="console" Jun 07 09:13:30.410697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410698 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="config-reloader" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410706 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="config-reloader" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410723 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="alertmanager" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410731 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="alertmanager" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410751 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="init-config-reloader" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410759 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="init-config-reloader" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410768 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410776 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410785 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="prom-label-proxy" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410793 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="prom-label-proxy" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410857 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="alertmanager" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410868 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-web" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:30.410871 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6\": container with ID starting with 09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6 not found: ID does not exist" containerID="09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410890 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6"} err="failed to get container status \"09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6\": rpc error: code = NotFound desc = could not find container \"09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6\": container with ID starting with 09fa5583afb5e3135a2484bfad4001d12dd126ecb6f41d1ec74943f25fddbea6 not found: ID does not exist" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410877 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="prom-label-proxy" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410911 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy-metric" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410920 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="config-reloader" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410927 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aaf5b09-0761-499a-9aad-58ecbab05de8" containerName="console" Jun 07 09:13:30.411037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.410932 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" containerName="kube-rbac-proxy" Jun 07 09:13:30.415593 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.415576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.417446 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417427 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 07 09:13:30.417595 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417578 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 07 09:13:30.417667 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417623 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 07 09:13:30.417862 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417846 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mnlbj\"" Jun 07 09:13:30.417928 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417909 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 07 09:13:30.417928 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417914 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 07 09:13:30.418032 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.417961 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 07 09:13:30.418083 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.418034 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 07 09:13:30.418083 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.418034 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 07 09:13:30.423135 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.423117 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 07 09:13:30.430653 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.430631 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:30.567049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.566972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-web-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-config-out\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkkj\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-kube-api-access-stkkj\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.567254 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.567243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668416 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-web-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.668677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-config-out\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669482 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669482 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669482 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkkj\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-kube-api-access-stkkj\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669482 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.668827 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669482 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.669230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.669787 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.669701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2e2f34f-3b07-4699-882d-2993c22a9962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.671876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.671649 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.671876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.671816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.671876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.671862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-web-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.672086 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.671862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.672086 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.671954 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.672086 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.672000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2e2f34f-3b07-4699-882d-2993c22a9962-config-out\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.672086 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.672049 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.672815 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.672797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.673121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.673101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2e2f34f-3b07-4699-882d-2993c22a9962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.675815 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.675798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkkj\" (UniqueName: \"kubernetes.io/projected/e2e2f34f-3b07-4699-882d-2993c22a9962-kube-api-access-stkkj\") pod \"alertmanager-main-0\" (UID: \"e2e2f34f-3b07-4699-882d-2993c22a9962\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.724942 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.724924 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 09:13:30.853675 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:30.853629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 09:13:30.856251 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:13:30.856225 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e2f34f_3b07_4699_882d_2993c22a9962.slice/crio-0aa01980708acf814bc90edb154eefcdcb7cb7c7daa0332ca827e4e2f86d4c07 WatchSource:0}: Error finding container 0aa01980708acf814bc90edb154eefcdcb7cb7c7daa0332ca827e4e2f86d4c07: Status 404 returned error can't find the container with id 0aa01980708acf814bc90edb154eefcdcb7cb7c7daa0332ca827e4e2f86d4c07 Jun 07 09:13:31.369115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:31.369078 2573 generic.go:356] "Generic (PLEG): container finished" podID="e2e2f34f-3b07-4699-882d-2993c22a9962" containerID="2ab7a0766f78d385981743c70b7d8a22c3f934b6d3b608ad26fe8aafa027ef82" exitCode=0 Jun 07 09:13:31.369513 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:31.369126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerDied","Data":"2ab7a0766f78d385981743c70b7d8a22c3f934b6d3b608ad26fe8aafa027ef82"} Jun 07 09:13:31.369513 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:31.369171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"0aa01980708acf814bc90edb154eefcdcb7cb7c7daa0332ca827e4e2f86d4c07"} Jun 07 09:13:32.301131 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.301100 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d5ca08-1ade-46a2-b94a-d4ab252b975b" path="/var/lib/kubelet/pods/56d5ca08-1ade-46a2-b94a-d4ab252b975b/volumes" Jun 07 09:13:32.375911 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.375879 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"12962d8aa0a70fdab66c16c13b1dbdf339db2e249f2ef8578da25cf5513dc56d"} Jun 07 09:13:32.376299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.375953 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"a8e8fd4d46b5a40f9c083c37364a00b978eb43f6d6e90b5f302f7b74c81e46b8"} Jun 07 09:13:32.376299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.376024 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"4ce06879e5f65af2a6fb83af620ce7a9f9e981cb1b97dfc36004dbe42429bf30"} Jun 07 09:13:32.376299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.376060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"538c916240db3867b0c3d037ba1daeee2220f309ae5e6bde71523fe735e2727d"} Jun 07 09:13:32.376299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.376098 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"0b83de8bc2f13bc3fb5dd710e10e150638fa088b336a939bd135f2f5f56fad16"} Jun 07 09:13:32.376299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.376134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2e2f34f-3b07-4699-882d-2993c22a9962","Type":"ContainerStarted","Data":"1d0074305b9b23fcff0a951b7bfc45981f0182a918738ab99938b3ed97e468b7"} Jun 07 09:13:32.402951 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:32.402905 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.386441337 podStartE2EDuration="2.402890261s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.448924ms" isStatefulPod=false podCreationTimestamp="2026-06-07 09:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:13:32.401225928 +0000 UTC m=+314.538096007" watchObservedRunningTime="2026-06-07 09:13:32.402890261 +0000 UTC m=+314.539760373" Jun 07 09:13:42.617229 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.617168 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bb67b7d96-zgrd9" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" containerID="cri-o://7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b" gracePeriod=15 Jun 07 09:13:42.852677 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.852655 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:13:42.858634 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858617 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858688 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858647 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858688 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858666 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858752 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858693 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858839 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858814 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858917 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858903 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l5jb\" (UniqueName: \"kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.858956 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.858942 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca\") pod \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\" (UID: \"d1a7d8e2-b711-4552-a051-0426e04a6bc2\") " Jun 07 09:13:42.859123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859087 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config" (OuterVolumeSpecName: "console-config") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:42.859123 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859106 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:42.859308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859154 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:42.859308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859210 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.859308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859230 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-oauth-serving-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.859308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859243 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-trusted-ca-bundle\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.859503 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.859380 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:13:42.860786 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.860764 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:42.860836 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.860779 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 09:13:42.860945 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.860924 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb" (OuterVolumeSpecName: "kube-api-access-6l5jb") pod "d1a7d8e2-b711-4552-a051-0426e04a6bc2" (UID: "d1a7d8e2-b711-4552-a051-0426e04a6bc2"). InnerVolumeSpecName "kube-api-access-6l5jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:13:42.959637 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.959614 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l5jb\" (UniqueName: \"kubernetes.io/projected/d1a7d8e2-b711-4552-a051-0426e04a6bc2-kube-api-access-6l5jb\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.959637 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.959633 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a7d8e2-b711-4552-a051-0426e04a6bc2-service-ca\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.959790 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.959642 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-oauth-config\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:42.959790 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:42.959651 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a7d8e2-b711-4552-a051-0426e04a6bc2-console-serving-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:13:43.420401 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.420305 2573 generic.go:356] "Generic (PLEG): container finished" podID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerID="7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b" exitCode=0 Jun 07 09:13:43.420401 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.420353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb67b7d96-zgrd9" event={"ID":"d1a7d8e2-b711-4552-a051-0426e04a6bc2","Type":"ContainerDied","Data":"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b"} Jun 07 09:13:43.420566 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.420403 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb67b7d96-zgrd9" event={"ID":"d1a7d8e2-b711-4552-a051-0426e04a6bc2","Type":"ContainerDied","Data":"7e3fba54888418218f9bcc6dbccdd583fb5276c74771dfa9e03a139a9f2bfb5d"} Jun 07 09:13:43.420566 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.420423 2573 scope.go:117] "RemoveContainer" containerID="7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b" Jun 07 09:13:43.420566 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.420368 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb67b7d96-zgrd9" Jun 07 09:13:43.428680 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.428665 2573 scope.go:117] "RemoveContainer" containerID="7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b" Jun 07 09:13:43.428923 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:13:43.428904 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b\": container with ID starting with 7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b not found: ID does not exist" containerID="7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b" Jun 07 09:13:43.428973 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.428931 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b"} err="failed to get container status \"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b\": rpc error: code = NotFound desc = could not find container \"7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b\": container with ID starting with 7655da9f38af2bb5418d21ed091b05027cb3807fb1e8654989749ca1b322541b not found: ID does not exist" Jun 07 09:13:43.438538 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.438511 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:13:43.440487 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:43.440468 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bb67b7d96-zgrd9"] Jun 07 09:13:44.301148 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:13:44.301120 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" path="/var/lib/kubelet/pods/d1a7d8e2-b711-4552-a051-0426e04a6bc2/volumes" Jun 07 09:14:44.788389 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.788357 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hncmb"] Jun 07 09:14:44.788813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.788601 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" Jun 07 09:14:44.788813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.788613 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" Jun 07 09:14:44.788813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.788667 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a7d8e2-b711-4552-a051-0426e04a6bc2" containerName="console" Jun 07 09:14:44.791415 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.791400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.793221 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.793197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xjh9r\"" Jun 07 09:14:44.793221 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.793217 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 09:14:44.793541 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.793526 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 09:14:44.797967 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.797670 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hncmb"] Jun 07 09:14:44.885160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.885126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcn8\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-kube-api-access-ckcn8\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.885308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.885178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.985855 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.985812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcn8\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-kube-api-access-ckcn8\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.985993 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.985873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.994348 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.994291 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcn8\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-kube-api-access-ckcn8\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:44.994487 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:44.994471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cfa3846-4c06-4e11-94d4-c68abb0d59bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hncmb\" (UID: \"1cfa3846-4c06-4e11-94d4-c68abb0d59bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:45.100768 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:45.100696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:45.219535 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:45.219491 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hncmb"] Jun 07 09:14:45.223833 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:14:45.223807 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cfa3846_4c06_4e11_94d4_c68abb0d59bb.slice/crio-b7a3b716953353eb93ce708d17d2ab4f480088fce3e9efd1844c1a820ab27b4b WatchSource:0}: Error finding container b7a3b716953353eb93ce708d17d2ab4f480088fce3e9efd1844c1a820ab27b4b: Status 404 returned error can't find the container with id b7a3b716953353eb93ce708d17d2ab4f480088fce3e9efd1844c1a820ab27b4b Jun 07 09:14:45.225456 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:45.225439 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 09:14:45.637528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:45.637499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" event={"ID":"1cfa3846-4c06-4e11-94d4-c68abb0d59bb","Type":"ContainerStarted","Data":"b7a3b716953353eb93ce708d17d2ab4f480088fce3e9efd1844c1a820ab27b4b"} Jun 07 09:14:48.651713 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:48.651678 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" event={"ID":"1cfa3846-4c06-4e11-94d4-c68abb0d59bb","Type":"ContainerStarted","Data":"4e817c1c120631652b379e46912fa7c1ce9f3814cb86732adf813dea228d276b"} Jun 07 09:14:48.652121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:48.651750 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:14:48.666180 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:48.666136 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" podStartSLOduration=1.883481481 podStartE2EDuration="4.666124806s" totalImagesPullingTime="2.782643325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:14:48.665912575 +0000 UTC m=+390.802782655" watchObservedRunningTime="2026-06-07 09:14:48.666124806 +0000 UTC m=+390.802994885" Jun 07 09:14:54.657045 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:14:54.657015 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hncmb" Jun 07 09:15:24.858867 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.858837 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s"] Jun 07 09:15:24.863338 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.863299 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:24.868779 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.868708 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 09:15:24.868779 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.868713 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 09:15:24.868779 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.868713 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 09:15:24.869876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.868996 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 09:15:24.869876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.869123 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 09:15:24.869876 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.869219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w4pn9\"" Jun 07 09:15:24.871418 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.871387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s"] Jun 07 09:15:24.969774 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.969748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-metrics-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:24.969922 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.969783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9363b43-373d-46ca-9964-af24ac479cb6-manager-config\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:24.969922 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.969800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:24.969922 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:24.969881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65v9\" (UniqueName: \"kubernetes.io/projected/d9363b43-373d-46ca-9964-af24ac479cb6-kube-api-access-m65v9\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.070984 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.070957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-metrics-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.071078 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.070993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9363b43-373d-46ca-9964-af24ac479cb6-manager-config\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.071078 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.071018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.071185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.071075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65v9\" (UniqueName: \"kubernetes.io/projected/d9363b43-373d-46ca-9964-af24ac479cb6-kube-api-access-m65v9\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.071669 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.071643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9363b43-373d-46ca-9964-af24ac479cb6-manager-config\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.073625 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.073595 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.073724 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.073598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9363b43-373d-46ca-9964-af24ac479cb6-metrics-cert\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.078903 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.078878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65v9\" (UniqueName: \"kubernetes.io/projected/d9363b43-373d-46ca-9964-af24ac479cb6-kube-api-access-m65v9\") pod \"lws-controller-manager-867d454bbd-tgr8s\" (UID: \"d9363b43-373d-46ca-9964-af24ac479cb6\") " pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.177178 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.177116 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:25.298282 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.298253 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s"] Jun 07 09:15:25.301425 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:15:25.301399 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9363b43_373d_46ca_9964_af24ac479cb6.slice/crio-f7cfff776791783cc89aae17830553b46fb13accda1feac1b4897bef33693fc9 WatchSource:0}: Error finding container f7cfff776791783cc89aae17830553b46fb13accda1feac1b4897bef33693fc9: Status 404 returned error can't find the container with id f7cfff776791783cc89aae17830553b46fb13accda1feac1b4897bef33693fc9 Jun 07 09:15:25.783919 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:25.783886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" event={"ID":"d9363b43-373d-46ca-9964-af24ac479cb6","Type":"ContainerStarted","Data":"f7cfff776791783cc89aae17830553b46fb13accda1feac1b4897bef33693fc9"} Jun 07 09:15:27.793121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:27.793088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" event={"ID":"d9363b43-373d-46ca-9964-af24ac479cb6","Type":"ContainerStarted","Data":"f0f120055e56a1aa7d430aa1e4f087d80de403b8bcfbcbc3b5cdb48f076af144"} Jun 07 09:15:27.793526 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:27.793160 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:27.806736 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:27.806694 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" podStartSLOduration=1.456664069 podStartE2EDuration="3.806681638s" totalImagesPullingTime="2.350017569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:15:27.806166471 +0000 UTC m=+429.943036563" watchObservedRunningTime="2026-06-07 09:15:27.806681638 +0000 UTC m=+429.943551716" Jun 07 09:15:33.226265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.226191 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf"] Jun 07 09:15:33.229553 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.229533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.232707 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.232685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 09:15:33.233463 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.233444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gmnw6\"" Jun 07 09:15:33.233564 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.233465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 09:15:33.233622 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.233581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 09:15:33.233676 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.233581 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 09:15:33.252467 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.252443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf"] Jun 07 09:15:33.332077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.332044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-manifests\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.332077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.332082 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.332316 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.332106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4rcv\" (UniqueName: \"kubernetes.io/projected/0ad9f4b6-9303-4043-b6aa-e68bb175600b-kube-api-access-x4rcv\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.332316 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.332127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.332316 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.332221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-tmp\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.432788 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.432752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-tmp\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.432949 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.432802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-manifests\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.432949 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.432913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.433035 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.432952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4rcv\" (UniqueName: \"kubernetes.io/projected/0ad9f4b6-9303-4043-b6aa-e68bb175600b-kube-api-access-x4rcv\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.433035 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.432989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.433193 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.433179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-manifests\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.435134 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.435113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad9f4b6-9303-4043-b6aa-e68bb175600b-tmp\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.435263 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.435247 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.435444 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.435423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad9f4b6-9303-4043-b6aa-e68bb175600b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.446524 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.446501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4rcv\" (UniqueName: \"kubernetes.io/projected/0ad9f4b6-9303-4043-b6aa-e68bb175600b-kube-api-access-x4rcv\") pod \"opendatahub-operator-controller-manager-84c76964bf-5psvf\" (UID: \"0ad9f4b6-9303-4043-b6aa-e68bb175600b\") " pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.540845 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.540762 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:33.671972 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.671946 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf"] Jun 07 09:15:33.674398 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:15:33.674370 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad9f4b6_9303_4043_b6aa_e68bb175600b.slice/crio-51891e3277a4a1b171dd5494c2c73848ece5e364be67d3026b26b6daf19ba196 WatchSource:0}: Error finding container 51891e3277a4a1b171dd5494c2c73848ece5e364be67d3026b26b6daf19ba196: Status 404 returned error can't find the container with id 51891e3277a4a1b171dd5494c2c73848ece5e364be67d3026b26b6daf19ba196 Jun 07 09:15:33.816378 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:33.816279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" event={"ID":"0ad9f4b6-9303-4043-b6aa-e68bb175600b","Type":"ContainerStarted","Data":"51891e3277a4a1b171dd5494c2c73848ece5e364be67d3026b26b6daf19ba196"} Jun 07 09:15:36.829614 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:36.829531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" event={"ID":"0ad9f4b6-9303-4043-b6aa-e68bb175600b","Type":"ContainerStarted","Data":"06fee802a425cd7de298d3fbf188b58ec3a92f5a05986b0e50d1d36bada9c4f1"} Jun 07 09:15:37.835128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:37.835030 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ad9f4b6-9303-4043-b6aa-e68bb175600b" containerID="06fee802a425cd7de298d3fbf188b58ec3a92f5a05986b0e50d1d36bada9c4f1" exitCode=0 Jun 07 09:15:37.835128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:37.835105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" event={"ID":"0ad9f4b6-9303-4043-b6aa-e68bb175600b","Type":"ContainerDied","Data":"06fee802a425cd7de298d3fbf188b58ec3a92f5a05986b0e50d1d36bada9c4f1"} Jun 07 09:15:38.799757 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:38.799726 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-867d454bbd-tgr8s" Jun 07 09:15:38.841050 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:38.841020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" event={"ID":"0ad9f4b6-9303-4043-b6aa-e68bb175600b","Type":"ContainerStarted","Data":"b294e61381c7f8c4444df02f4408c240b233e57e6e2d8a18a1a8da576d214f90"} Jun 07 09:15:38.841481 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:38.841158 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:15:38.857775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:38.857725 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" podStartSLOduration=1.714218419 podStartE2EDuration="5.857711345s" totalImagesPullingTime="3.200939112s" totalInitContainerRuntime="942.553814ms" isStatefulPod=false podCreationTimestamp="2026-06-07 09:15:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:15:38.85705022 +0000 UTC m=+440.993920299" watchObservedRunningTime="2026-06-07 09:15:38.857711345 +0000 UTC m=+440.994581424" Jun 07 09:15:49.847673 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:15:49.847643 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84c76964bf-5psvf" Jun 07 09:16:25.559282 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.559252 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9"] Jun 07 09:16:25.563832 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.563816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.565781 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.565757 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 09:16:25.565781 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.565764 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 09:16:25.565913 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.565766 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ww6zh\"" Jun 07 09:16:25.565913 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.565875 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 09:16:25.572257 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.572235 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9"] Jun 07 09:16:25.653457 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653733 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653733 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjt8\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-kube-api-access-5kjt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653733 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.653733 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.653707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754238 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754238 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjt8\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-kube-api-access-5kjt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754465 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754465 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754465 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754654 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754471 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754654 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754654 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754654 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754848 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754848 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754927 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.754988 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.754971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.755119 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.755096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.756745 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.756721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.756893 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.756873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.761474 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.761452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjt8\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-kube-api-access-5kjt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.762637 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.762617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fe0b70-3682-4394-9ef7-e5e147ddc36d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795677m9\" (UID: \"e5fe0b70-3682-4394-9ef7-e5e147ddc36d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:25.875055 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:25.874984 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:26.004491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:26.004460 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9"] Jun 07 09:16:26.008234 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:16:26.008198 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fe0b70_3682_4394_9ef7_e5e147ddc36d.slice/crio-17f450c1589d1007bac2e84b09ec70c272b472029e510ad823031244fa0f96eb WatchSource:0}: Error finding container 17f450c1589d1007bac2e84b09ec70c272b472029e510ad823031244fa0f96eb: Status 404 returned error can't find the container with id 17f450c1589d1007bac2e84b09ec70c272b472029e510ad823031244fa0f96eb Jun 07 09:16:26.022676 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:26.022650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" event={"ID":"e5fe0b70-3682-4394-9ef7-e5e147ddc36d","Type":"ContainerStarted","Data":"17f450c1589d1007bac2e84b09ec70c272b472029e510ad823031244fa0f96eb"} Jun 07 09:16:28.669942 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:28.669894 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:16:28.670279 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:28.670001 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:16:28.670279 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:28.670046 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:16:29.037071 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.037030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" event={"ID":"e5fe0b70-3682-4394-9ef7-e5e147ddc36d","Type":"ContainerStarted","Data":"b22d50ecdeac4a07e33f70d1085855db5fee14a14c394ff61780cf7f3c9fa2b3"} Jun 07 09:16:29.055066 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.055015 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" podStartSLOduration=1.395692067 podStartE2EDuration="4.055000874s" totalImagesPullingTime="2.659308807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:16:29.053022995 +0000 UTC m=+491.189893099" watchObservedRunningTime="2026-06-07 09:16:29.055000874 +0000 UTC m=+491.191870953" Jun 07 09:16:29.414861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.414786 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8f57c774b-dl5kp"] Jun 07 09:16:29.418542 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.418519 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.420441 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.420420 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7hqtt\"" Jun 07 09:16:29.420441 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.420436 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 09:16:29.426359 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.426234 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8f57c774b-dl5kp"] Jun 07 09:16:29.479917 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.479883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxk7n\" (UniqueName: \"kubernetes.io/projected/9af296f2-0f00-4640-90ea-c92eca1a74cc-kube-api-access-rxk7n\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.480061 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.479943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9af296f2-0f00-4640-90ea-c92eca1a74cc-redirect-config\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.580892 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.580865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9af296f2-0f00-4640-90ea-c92eca1a74cc-redirect-config\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.581043 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.580913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxk7n\" (UniqueName: \"kubernetes.io/projected/9af296f2-0f00-4640-90ea-c92eca1a74cc-kube-api-access-rxk7n\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.581559 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.581540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9af296f2-0f00-4640-90ea-c92eca1a74cc-redirect-config\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.587995 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.587972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxk7n\" (UniqueName: \"kubernetes.io/projected/9af296f2-0f00-4640-90ea-c92eca1a74cc-kube-api-access-rxk7n\") pod \"dashboard-redirect-8f57c774b-dl5kp\" (UID: \"9af296f2-0f00-4640-90ea-c92eca1a74cc\") " pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.730748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.730723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" Jun 07 09:16:29.853659 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.853618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8f57c774b-dl5kp"] Jun 07 09:16:29.856225 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:16:29.856194 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af296f2_0f00_4640_90ea_c92eca1a74cc.slice/crio-3678d65c359465b430306f04ac451ee7bff46bf53f8d83cb7798473496dd49df WatchSource:0}: Error finding container 3678d65c359465b430306f04ac451ee7bff46bf53f8d83cb7798473496dd49df: Status 404 returned error can't find the container with id 3678d65c359465b430306f04ac451ee7bff46bf53f8d83cb7798473496dd49df Jun 07 09:16:29.876068 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.876045 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:29.880294 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:29.880275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:30.041921 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:30.041836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" event={"ID":"9af296f2-0f00-4640-90ea-c92eca1a74cc","Type":"ContainerStarted","Data":"3678d65c359465b430306f04ac451ee7bff46bf53f8d83cb7798473496dd49df"} Jun 07 09:16:30.042074 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:30.042059 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:30.043009 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:30.042991 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795677m9" Jun 07 09:16:32.051781 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:32.051744 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" event={"ID":"9af296f2-0f00-4640-90ea-c92eca1a74cc","Type":"ContainerStarted","Data":"45dcf774bbf4cd30b865520c9113ff691c5b5e68157b6fb91e5a06be13514179"} Jun 07 09:16:32.066595 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:32.066550 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8f57c774b-dl5kp" podStartSLOduration=1.380777355 podStartE2EDuration="3.066536258s" totalImagesPullingTime="1.685758903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:16:32.065197281 +0000 UTC m=+494.202067358" watchObservedRunningTime="2026-06-07 09:16:32.066536258 +0000 UTC m=+494.203406336" Jun 07 09:16:53.307157 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.307122 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:53.309923 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.309896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:53.311663 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.311632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rq2vj\"" Jun 07 09:16:53.311837 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.311813 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 09:16:53.311968 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.311947 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 09:16:53.320113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.320089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:53.363144 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.363113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdczm\" (UniqueName: \"kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm\") pod \"kuadrant-operator-catalog-pdxlg\" (UID: \"b9796eb1-3dfe-4d37-8fa7-04161cccd56c\") " pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:53.463618 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.463588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdczm\" (UniqueName: \"kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm\") pod \"kuadrant-operator-catalog-pdxlg\" (UID: \"b9796eb1-3dfe-4d37-8fa7-04161cccd56c\") " pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:53.470884 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.470860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdczm\" (UniqueName: \"kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm\") pod \"kuadrant-operator-catalog-pdxlg\" (UID: \"b9796eb1-3dfe-4d37-8fa7-04161cccd56c\") " pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:53.621851 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.621778 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:53.683304 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.683272 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:53.744302 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.744277 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:53.746820 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:16:53.746792 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9796eb1_3dfe_4d37_8fa7_04161cccd56c.slice/crio-39ba14fb758cabd3682bb9641b311671337c76d808e4ddb78a7873d84b1da51a WatchSource:0}: Error finding container 39ba14fb758cabd3682bb9641b311671337c76d808e4ddb78a7873d84b1da51a: Status 404 returned error can't find the container with id 39ba14fb758cabd3682bb9641b311671337c76d808e4ddb78a7873d84b1da51a Jun 07 09:16:53.892761 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.892685 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-296kv"] Jun 07 09:16:53.895661 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.895645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:16:53.903093 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.903028 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-296kv"] Jun 07 09:16:53.967883 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:53.967858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlszw\" (UniqueName: \"kubernetes.io/projected/3d67a13c-e10e-485d-a588-039f3ba0c7b2-kube-api-access-jlszw\") pod \"kuadrant-operator-catalog-296kv\" (UID: \"3d67a13c-e10e-485d-a588-039f3ba0c7b2\") " pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:16:54.068318 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:54.068284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlszw\" (UniqueName: \"kubernetes.io/projected/3d67a13c-e10e-485d-a588-039f3ba0c7b2-kube-api-access-jlszw\") pod \"kuadrant-operator-catalog-296kv\" (UID: \"3d67a13c-e10e-485d-a588-039f3ba0c7b2\") " pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:16:54.075714 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:54.075693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlszw\" (UniqueName: \"kubernetes.io/projected/3d67a13c-e10e-485d-a588-039f3ba0c7b2-kube-api-access-jlszw\") pod \"kuadrant-operator-catalog-296kv\" (UID: \"3d67a13c-e10e-485d-a588-039f3ba0c7b2\") " pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:16:54.133918 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:54.133890 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" event={"ID":"b9796eb1-3dfe-4d37-8fa7-04161cccd56c","Type":"ContainerStarted","Data":"39ba14fb758cabd3682bb9641b311671337c76d808e4ddb78a7873d84b1da51a"} Jun 07 09:16:54.206605 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:54.206575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:16:54.332365 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:54.332313 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-296kv"] Jun 07 09:16:54.334896 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:16:54.334872 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d67a13c_e10e_485d_a588_039f3ba0c7b2.slice/crio-0c1180f9a2698b86637567547915ebe9643853fd68369779c3240104da339d0a WatchSource:0}: Error finding container 0c1180f9a2698b86637567547915ebe9643853fd68369779c3240104da339d0a: Status 404 returned error can't find the container with id 0c1180f9a2698b86637567547915ebe9643853fd68369779c3240104da339d0a Jun 07 09:16:55.140475 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:55.140438 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-296kv" event={"ID":"3d67a13c-e10e-485d-a588-039f3ba0c7b2","Type":"ContainerStarted","Data":"0c1180f9a2698b86637567547915ebe9643853fd68369779c3240104da339d0a"} Jun 07 09:16:57.149871 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.149831 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-296kv" event={"ID":"3d67a13c-e10e-485d-a588-039f3ba0c7b2","Type":"ContainerStarted","Data":"8a80fb41f952d4a8a43606915daaa7ec096b01e1401f38675cb33ceba55d484e"} Jun 07 09:16:57.151371 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.151347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" event={"ID":"b9796eb1-3dfe-4d37-8fa7-04161cccd56c","Type":"ContainerStarted","Data":"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15"} Jun 07 09:16:57.151436 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.151394 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" podUID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" containerName="registry-server" containerID="cri-o://450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15" gracePeriod=2 Jun 07 09:16:57.164414 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.164366 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-296kv" podStartSLOduration=2.347992574 podStartE2EDuration="4.164349383s" totalImagesPullingTime="1.816356809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:16:57.163344132 +0000 UTC m=+519.300214202" watchObservedRunningTime="2026-06-07 09:16:57.164349383 +0000 UTC m=+519.301219462" Jun 07 09:16:57.177253 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.177214 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" podStartSLOduration=1.775878992 podStartE2EDuration="4.177204559s" totalImagesPullingTime="2.401325567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:16:57.176423167 +0000 UTC m=+519.313293256" watchObservedRunningTime="2026-06-07 09:16:57.177204559 +0000 UTC m=+519.314074638" Jun 07 09:16:57.388863 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.388841 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:57.499521 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.499485 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdczm\" (UniqueName: \"kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm\") pod \"b9796eb1-3dfe-4d37-8fa7-04161cccd56c\" (UID: \"b9796eb1-3dfe-4d37-8fa7-04161cccd56c\") " Jun 07 09:16:57.501583 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.501559 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm" (OuterVolumeSpecName: "kube-api-access-cdczm") pod "b9796eb1-3dfe-4d37-8fa7-04161cccd56c" (UID: "b9796eb1-3dfe-4d37-8fa7-04161cccd56c"). InnerVolumeSpecName "kube-api-access-cdczm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:16:57.600348 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:57.600306 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdczm\" (UniqueName: \"kubernetes.io/projected/b9796eb1-3dfe-4d37-8fa7-04161cccd56c-kube-api-access-cdczm\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:16:58.157142 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.157109 2573 generic.go:356] "Generic (PLEG): container finished" podID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" containerID="450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15" exitCode=0 Jun 07 09:16:58.157639 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.157154 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" Jun 07 09:16:58.157639 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.157194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" event={"ID":"b9796eb1-3dfe-4d37-8fa7-04161cccd56c","Type":"ContainerDied","Data":"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15"} Jun 07 09:16:58.157639 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.157244 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdxlg" event={"ID":"b9796eb1-3dfe-4d37-8fa7-04161cccd56c","Type":"ContainerDied","Data":"39ba14fb758cabd3682bb9641b311671337c76d808e4ddb78a7873d84b1da51a"} Jun 07 09:16:58.157639 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.157266 2573 scope.go:117] "RemoveContainer" containerID="450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15" Jun 07 09:16:58.166125 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.166104 2573 scope.go:117] "RemoveContainer" containerID="450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15" Jun 07 09:16:58.166456 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:16:58.166437 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15\": container with ID starting with 450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15 not found: ID does not exist" containerID="450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15" Jun 07 09:16:58.166532 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.166463 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15"} err="failed to get container status \"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15\": rpc error: code = NotFound desc = could not find container \"450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15\": container with ID starting with 450cd4fdab31691a57f3ad8ef675875af52ea830e26dbea7fcdc4dbca06cef15 not found: ID does not exist" Jun 07 09:16:58.176429 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.176409 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:58.180590 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.180570 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdxlg"] Jun 07 09:16:58.302205 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:16:58.302181 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" path="/var/lib/kubelet/pods/b9796eb1-3dfe-4d37-8fa7-04161cccd56c/volumes" Jun 07 09:17:04.206872 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:04.206797 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:17:04.206872 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:04.206854 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:17:04.228891 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:04.228866 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:17:05.205348 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:05.205309 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-296kv" Jun 07 09:17:21.162276 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.162242 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f6d677c-xp2pr"] Jun 07 09:17:21.162638 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.162551 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" containerName="registry-server" Jun 07 09:17:21.162638 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.162563 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" containerName="registry-server" Jun 07 09:17:21.162638 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.162625 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9796eb1-3dfe-4d37-8fa7-04161cccd56c" containerName="registry-server" Jun 07 09:17:21.171823 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.171802 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.173908 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.173886 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 09:17:21.174527 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174507 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174667 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174507 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174549 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174614 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 09:17:21.174860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.174671 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k2swh\"" Jun 07 09:17:21.175124 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.175068 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6d677c-xp2pr"] Jun 07 09:17:21.179964 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.179891 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 09:17:21.292085 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-console-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-service-ca\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-oauth-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-trusted-ca-bundle\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-oauth-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.292491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.292314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9pw\" (UniqueName: \"kubernetes.io/projected/66412ba7-bae8-43a3-8d96-46fa3859305c-kube-api-access-8q9pw\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.392860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.392829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-oauth-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.392860 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.392859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-trusted-ca-bundle\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.392881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-oauth-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.392903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9pw\" (UniqueName: \"kubernetes.io/projected/66412ba7-bae8-43a3-8d96-46fa3859305c-kube-api-access-8q9pw\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.392951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-console-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393037 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393077 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-service-ca\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393630 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393604 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-oauth-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393769 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-service-ca\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393845 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-trusted-ca-bundle\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.393904 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.393842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66412ba7-bae8-43a3-8d96-46fa3859305c-console-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.395370 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.395349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-oauth-config\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.395604 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.395586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66412ba7-bae8-43a3-8d96-46fa3859305c-console-serving-cert\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.401990 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.401965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9pw\" (UniqueName: \"kubernetes.io/projected/66412ba7-bae8-43a3-8d96-46fa3859305c-kube-api-access-8q9pw\") pod \"console-7f6d677c-xp2pr\" (UID: \"66412ba7-bae8-43a3-8d96-46fa3859305c\") " pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.482883 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.482855 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:21.611015 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:21.610583 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6d677c-xp2pr"] Jun 07 09:17:21.613268 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:17:21.613239 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66412ba7_bae8_43a3_8d96_46fa3859305c.slice/crio-a50402a2906f5cf6b5221cf187e0da34a9706343799c03772a2109f44c80f348 WatchSource:0}: Error finding container a50402a2906f5cf6b5221cf187e0da34a9706343799c03772a2109f44c80f348: Status 404 returned error can't find the container with id a50402a2906f5cf6b5221cf187e0da34a9706343799c03772a2109f44c80f348 Jun 07 09:17:22.264601 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:22.264566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6d677c-xp2pr" event={"ID":"66412ba7-bae8-43a3-8d96-46fa3859305c","Type":"ContainerStarted","Data":"7934a13b6d8914d70f8601e94ca0221194829d037058b0b99c0d4db86ad8b6ca"} Jun 07 09:17:22.265002 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:22.264611 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6d677c-xp2pr" event={"ID":"66412ba7-bae8-43a3-8d96-46fa3859305c","Type":"ContainerStarted","Data":"a50402a2906f5cf6b5221cf187e0da34a9706343799c03772a2109f44c80f348"} Jun 07 09:17:22.298037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:22.297981 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f6d677c-xp2pr" podStartSLOduration=1.297965891 podStartE2EDuration="1.297965891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:17:22.297965653 +0000 UTC m=+544.434835733" watchObservedRunningTime="2026-06-07 09:17:22.297965891 +0000 UTC m=+544.434835970" Jun 07 09:17:24.913159 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:24.913124 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-db2nk"] Jun 07 09:17:24.915532 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:24.915507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:24.917454 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:24.917430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sdvgl\"" Jun 07 09:17:24.923986 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:24.923961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xrl\" (UniqueName: \"kubernetes.io/projected/33fe47b7-7992-4b09-b2d5-9f54bfc6f850-kube-api-access-k2xrl\") pod \"authorino-operator-75cc8d5cb7-db2nk\" (UID: \"33fe47b7-7992-4b09-b2d5-9f54bfc6f850\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:24.925739 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:24.925717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-db2nk"] Jun 07 09:17:25.024486 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:25.024455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xrl\" (UniqueName: \"kubernetes.io/projected/33fe47b7-7992-4b09-b2d5-9f54bfc6f850-kube-api-access-k2xrl\") pod \"authorino-operator-75cc8d5cb7-db2nk\" (UID: \"33fe47b7-7992-4b09-b2d5-9f54bfc6f850\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:25.038573 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:25.038549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xrl\" (UniqueName: \"kubernetes.io/projected/33fe47b7-7992-4b09-b2d5-9f54bfc6f850-kube-api-access-k2xrl\") pod \"authorino-operator-75cc8d5cb7-db2nk\" (UID: \"33fe47b7-7992-4b09-b2d5-9f54bfc6f850\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:25.226125 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:25.226100 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:25.352145 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:25.352113 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-db2nk"] Jun 07 09:17:25.354986 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:17:25.354955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fe47b7_7992_4b09_b2d5_9f54bfc6f850.slice/crio-dc0de7c6aca6b0436699a0b527c7ecdb8d5de2fbe4252e64e5ffcefa9c0f1a32 WatchSource:0}: Error finding container dc0de7c6aca6b0436699a0b527c7ecdb8d5de2fbe4252e64e5ffcefa9c0f1a32: Status 404 returned error can't find the container with id dc0de7c6aca6b0436699a0b527c7ecdb8d5de2fbe4252e64e5ffcefa9c0f1a32 Jun 07 09:17:26.285457 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:26.285415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" event={"ID":"33fe47b7-7992-4b09-b2d5-9f54bfc6f850","Type":"ContainerStarted","Data":"dc0de7c6aca6b0436699a0b527c7ecdb8d5de2fbe4252e64e5ffcefa9c0f1a32"} Jun 07 09:17:28.295765 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:28.295733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" event={"ID":"33fe47b7-7992-4b09-b2d5-9f54bfc6f850","Type":"ContainerStarted","Data":"3b2dea37f773f4ad7454431f8a0a9323c88a656f3fc8e08212f2d80fcde2da48"} Jun 07 09:17:28.296149 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:28.295790 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:28.311458 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:28.311412 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" podStartSLOduration=2.26682374 podStartE2EDuration="4.311396964s" totalImagesPullingTime="2.044573224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:17:28.310619197 +0000 UTC m=+550.447489275" watchObservedRunningTime="2026-06-07 09:17:28.311396964 +0000 UTC m=+550.448267042" Jun 07 09:17:29.464446 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.464404 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9"] Jun 07 09:17:29.472317 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.472296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.474526 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.474505 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4ljbr\"" Jun 07 09:17:29.477597 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.477574 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9"] Jun 07 09:17:29.560177 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.560143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8rtd\" (UniqueName: \"kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.560308 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.560197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.660891 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.660863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8rtd\" (UniqueName: \"kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.661026 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.660899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.661220 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.661205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.680588 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.680561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8rtd\" (UniqueName: \"kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.783215 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.783159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:29.915672 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:29.915647 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9"] Jun 07 09:17:29.918221 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:17:29.918195 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9d0df0_f3e6_4cd7_aaca_8b50507a24f1.slice/crio-89ab260e41c50fd6ab6bfbb8891a426711db80374937e08d5dcf5fa7b52f0522 WatchSource:0}: Error finding container 89ab260e41c50fd6ab6bfbb8891a426711db80374937e08d5dcf5fa7b52f0522: Status 404 returned error can't find the container with id 89ab260e41c50fd6ab6bfbb8891a426711db80374937e08d5dcf5fa7b52f0522 Jun 07 09:17:30.304750 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:30.304718 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" event={"ID":"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1","Type":"ContainerStarted","Data":"89ab260e41c50fd6ab6bfbb8891a426711db80374937e08d5dcf5fa7b52f0522"} Jun 07 09:17:31.483266 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:31.483235 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:31.483762 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:31.483338 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:31.488666 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:31.488643 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:32.318047 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:32.318018 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f6d677c-xp2pr" Jun 07 09:17:35.329463 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:35.329424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" event={"ID":"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1","Type":"ContainerStarted","Data":"9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479"} Jun 07 09:17:35.329934 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:35.329494 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:35.352546 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:35.352444 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" podStartSLOduration=1.176045558 podStartE2EDuration="6.352427684s" totalImagesPullingTime="5.176382126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:17:35.350674842 +0000 UTC m=+557.487544920" watchObservedRunningTime="2026-06-07 09:17:35.352427684 +0000 UTC m=+557.489297762" Jun 07 09:17:37.873706 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.873673 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg"] Jun 07 09:17:37.877014 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.876980 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:37.879005 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.878982 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 07 09:17:37.879153 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.878984 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 07 09:17:37.879153 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.879095 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jdchw\"" Jun 07 09:17:37.884371 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.884349 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg"] Jun 07 09:17:37.935480 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.935454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ea6d58-95cc-49f9-af1d-7bc577597529-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:37.935480 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.935483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ea6d58-95cc-49f9-af1d-7bc577597529-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:37.935655 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:37.935525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjtb2\" (UniqueName: \"kubernetes.io/projected/80ea6d58-95cc-49f9-af1d-7bc577597529-kube-api-access-mjtb2\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.036440 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.036405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ea6d58-95cc-49f9-af1d-7bc577597529-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.036598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.036444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ea6d58-95cc-49f9-af1d-7bc577597529-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.036598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.036476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjtb2\" (UniqueName: \"kubernetes.io/projected/80ea6d58-95cc-49f9-af1d-7bc577597529-kube-api-access-mjtb2\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.037084 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.037055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ea6d58-95cc-49f9-af1d-7bc577597529-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.038800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.038775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ea6d58-95cc-49f9-af1d-7bc577597529-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.050902 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.050875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjtb2\" (UniqueName: \"kubernetes.io/projected/80ea6d58-95cc-49f9-af1d-7bc577597529-kube-api-access-mjtb2\") pod \"kuadrant-console-plugin-66b5774985-fmxxg\" (UID: \"80ea6d58-95cc-49f9-af1d-7bc577597529\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.189300 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.189274 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" Jun 07 09:17:38.313505 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.313484 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg"] Jun 07 09:17:38.316043 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:17:38.316006 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ea6d58_95cc_49f9_af1d_7bc577597529.slice/crio-c1bee123f938f9c8f2b2a0d017450fe1b18bfde63e2e5a454165472394bbe574 WatchSource:0}: Error finding container c1bee123f938f9c8f2b2a0d017450fe1b18bfde63e2e5a454165472394bbe574: Status 404 returned error can't find the container with id c1bee123f938f9c8f2b2a0d017450fe1b18bfde63e2e5a454165472394bbe574 Jun 07 09:17:38.342306 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:38.342274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" event={"ID":"80ea6d58-95cc-49f9-af1d-7bc577597529","Type":"ContainerStarted","Data":"c1bee123f938f9c8f2b2a0d017450fe1b18bfde63e2e5a454165472394bbe574"} Jun 07 09:17:39.302121 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:39.302092 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-db2nk" Jun 07 09:17:46.334577 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:46.334551 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:47.912986 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.912943 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9"] Jun 07 09:17:47.913489 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.913236 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" containerName="manager" containerID="cri-o://9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479" gracePeriod=2 Jun 07 09:17:47.915461 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:17:47.915421 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:47.917789 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.917762 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9"] Jun 07 09:17:47.950978 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.950942 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn"] Jun 07 09:17:47.951387 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.951368 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" containerName="manager" Jun 07 09:17:47.951387 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.951387 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" containerName="manager" Jun 07 09:17:47.951586 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.951471 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" containerName="manager" Jun 07 09:17:47.954950 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.954831 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:17:47.957373 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.957234 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dvwkl\"" Jun 07 09:17:47.965143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:47.965118 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn"] Jun 07 09:17:47.979864 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:17:47.979833 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:17:48.028703 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:48.028667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzwj\" (UniqueName: \"kubernetes.io/projected/4cbe979d-306a-4e9c-974d-1a4570692c97-kube-api-access-wnzwj\") pod \"limitador-operator-controller-manager-859d7b78bd-p94qn\" (UID: \"4cbe979d-306a-4e9c-974d-1a4570692c97\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:17:48.129773 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:48.129720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzwj\" (UniqueName: \"kubernetes.io/projected/4cbe979d-306a-4e9c-974d-1a4570692c97-kube-api-access-wnzwj\") pod \"limitador-operator-controller-manager-859d7b78bd-p94qn\" (UID: \"4cbe979d-306a-4e9c-974d-1a4570692c97\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:17:48.138893 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:48.138856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzwj\" (UniqueName: \"kubernetes.io/projected/4cbe979d-306a-4e9c-974d-1a4570692c97-kube-api-access-wnzwj\") pod \"limitador-operator-controller-manager-859d7b78bd-p94qn\" (UID: \"4cbe979d-306a-4e9c-974d-1a4570692c97\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:17:48.280559 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:17:48.280520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:17:48.301051 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:17:48.301000 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:01.665213 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.665178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn"] Jun 07 09:18:01.711151 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:18:01.711116 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbe979d_306a_4e9c_974d_1a4570692c97.slice/crio-c25ade287bd84e3cd2c6289fbe6c1e3b7586722a4bff4abf4ddc501285f1bcc1 WatchSource:0}: Error finding container c25ade287bd84e3cd2c6289fbe6c1e3b7586722a4bff4abf4ddc501285f1bcc1: Status 404 returned error can't find the container with id c25ade287bd84e3cd2c6289fbe6c1e3b7586722a4bff4abf4ddc501285f1bcc1 Jun 07 09:18:01.734411 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.734389 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:01.736597 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:18:01.736568 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:01.854050 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.854027 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume\") pod \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " Jun 07 09:18:01.854163 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.854069 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8rtd\" (UniqueName: \"kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd\") pod \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\" (UID: \"4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1\") " Jun 07 09:18:01.854547 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.854525 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" (UID: "4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:18:01.855879 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.855855 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd" (OuterVolumeSpecName: "kube-api-access-k8rtd") pod "4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" (UID: "4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1"). InnerVolumeSpecName "kube-api-access-k8rtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:18:01.955386 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.955357 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-extensions-socket-volume\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:18:01.955386 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:01.955381 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8rtd\" (UniqueName: \"kubernetes.io/projected/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1-kube-api-access-k8rtd\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:18:02.304160 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.304118 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" path="/var/lib/kubelet/pods/4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1/volumes" Jun 07 09:18:02.462146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.462111 2573 generic.go:356] "Generic (PLEG): container finished" podID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" containerID="9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479" exitCode=0 Jun 07 09:18:02.462317 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.462163 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:02.462317 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.462241 2573 scope.go:117] "RemoveContainer" containerID="9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479" Jun 07 09:18:02.464069 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:18:02.464037 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:02.465358 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.464847 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" event={"ID":"80ea6d58-95cc-49f9-af1d-7bc577597529","Type":"ContainerStarted","Data":"d0b27a638f33613aa667f111086b23bb9b8432c42913aaf5b26ab134e1fe2102"} Jun 07 09:18:02.466139 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:18:02.466111 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:02.466735 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.466698 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" event={"ID":"4cbe979d-306a-4e9c-974d-1a4570692c97","Type":"ContainerStarted","Data":"c25ade287bd84e3cd2c6289fbe6c1e3b7586722a4bff4abf4ddc501285f1bcc1"} Jun 07 09:18:02.480143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.480090 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fmxxg" podStartSLOduration=2.049574266 podStartE2EDuration="25.480070247s" totalImagesPullingTime="23.430495981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:18:02.478705542 +0000 UTC m=+584.615575634" watchObservedRunningTime="2026-06-07 09:18:02.480070247 +0000 UTC m=+584.616940325" Jun 07 09:18:02.480250 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:18:02.480174 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v6sf9\" is forbidden: User \"system:node:ip-10-0-134-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-51.ec2.internal' and this object" podUID="4c9d0df0-f3e6-4cd7-aaca-8b50507a24f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v6sf9" Jun 07 09:18:02.613165 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.613044 2573 scope.go:117] "RemoveContainer" containerID="9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479" Jun 07 09:18:02.613852 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:18:02.613829 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479\": container with ID starting with 9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479 not found: ID does not exist" containerID="9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479" Jun 07 09:18:02.613960 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:02.613863 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479"} err="failed to get container status \"9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479\": rpc error: code = NotFound desc = could not find container \"9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479\": container with ID starting with 9290033c244e3ed03f38d70f5080090dbc936f46a46c833ca8cf2dc28069b479 not found: ID does not exist" Jun 07 09:18:04.479514 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:04.479468 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" event={"ID":"4cbe979d-306a-4e9c-974d-1a4570692c97","Type":"ContainerStarted","Data":"450d36bdef41f3280a5c5286ff920ec99c1c0c310a440adf8d8a0d04bd2cd31e"} Jun 07 09:18:04.479897 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:04.479561 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:18:15.486185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:15.486158 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" Jun 07 09:18:15.501390 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:15.501336 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p94qn" podStartSLOduration=26.681660309 podStartE2EDuration="28.501302467s" totalImagesPullingTime="1.819642158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:18:04.493547844 +0000 UTC m=+586.630417922" watchObservedRunningTime="2026-06-07 09:18:15.501302467 +0000 UTC m=+597.638172546" Jun 07 09:18:18.270813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:18.270788 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:18:18.271247 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:18.270889 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:18:24.784456 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.784419 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:18:24.814994 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.814962 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:18:24.815153 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.815008 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:18:24.815153 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.815075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:24.817226 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.817201 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 09:18:24.926049 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.926022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4749108-1be7-4ea7-b000-3e494a6559ec-config-file\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:24.926193 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:24.926089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb5bd\" (UniqueName: \"kubernetes.io/projected/a4749108-1be7-4ea7-b000-3e494a6559ec-kube-api-access-sb5bd\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.027071 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.027041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb5bd\" (UniqueName: \"kubernetes.io/projected/a4749108-1be7-4ea7-b000-3e494a6559ec-kube-api-access-sb5bd\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.027212 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.027100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4749108-1be7-4ea7-b000-3e494a6559ec-config-file\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.027729 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.027709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4749108-1be7-4ea7-b000-3e494a6559ec-config-file\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.034369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.034346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb5bd\" (UniqueName: \"kubernetes.io/projected/a4749108-1be7-4ea7-b000-3e494a6559ec-kube-api-access-sb5bd\") pod \"limitador-limitador-54d6d988d5-m4vjd\" (UID: \"a4749108-1be7-4ea7-b000-3e494a6559ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.126739 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.126666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:25.255477 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.255443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:18:25.258393 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:18:25.258366 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4749108_1be7_4ea7_b000_3e494a6559ec.slice/crio-2d1937613bf1942b37daab7aff5624c95c7d6ee5ab5ed27767f9858599198f35 WatchSource:0}: Error finding container 2d1937613bf1942b37daab7aff5624c95c7d6ee5ab5ed27767f9858599198f35: Status 404 returned error can't find the container with id 2d1937613bf1942b37daab7aff5624c95c7d6ee5ab5ed27767f9858599198f35 Jun 07 09:18:25.572422 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:25.572393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" event={"ID":"a4749108-1be7-4ea7-b000-3e494a6559ec","Type":"ContainerStarted","Data":"2d1937613bf1942b37daab7aff5624c95c7d6ee5ab5ed27767f9858599198f35"} Jun 07 09:18:28.587426 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:28.587391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" event={"ID":"a4749108-1be7-4ea7-b000-3e494a6559ec","Type":"ContainerStarted","Data":"dcb12d1d6c372f83c3c12125c8448da33cb5e9c291722437ab3ebf5b775205e0"} Jun 07 09:18:28.587834 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:28.587523 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:18:28.604536 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:28.604491 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" podStartSLOduration=2.178932687 podStartE2EDuration="4.604478593s" totalImagesPullingTime="2.425545906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:18:28.602726571 +0000 UTC m=+610.739596650" watchObservedRunningTime="2026-06-07 09:18:28.604478593 +0000 UTC m=+610.741348672" Jun 07 09:18:39.592802 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:18:39.592728 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m4vjd" Jun 07 09:20:28.436939 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:20:28.436907 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:21:24.595662 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:24.595623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:21:42.876991 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.876914 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8"] Jun 07 09:21:42.880355 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.880317 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:42.882359 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.882338 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 09:21:42.882445 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.882342 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 07 09:21:42.882718 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.882700 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 09:21:42.882863 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.882832 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-htb4v\"" Jun 07 09:21:42.888935 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:42.888913 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8"] Jun 07 09:21:43.003485 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.003659 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.003659 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dpt\" (UniqueName: \"kubernetes.io/projected/35d39d35-55cf-48f2-999e-576cf58c3525-kube-api-access-v5dpt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.003777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.003777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d39d35-55cf-48f2-999e-576cf58c3525-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.003864 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.003776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104396 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dpt\" (UniqueName: \"kubernetes.io/projected/35d39d35-55cf-48f2-999e-576cf58c3525-kube-api-access-v5dpt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d39d35-55cf-48f2-999e-576cf58c3525-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.104936 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.105064 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.105064 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.104979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.106848 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.106821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d39d35-55cf-48f2-999e-576cf58c3525-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.106952 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.106927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d39d35-55cf-48f2-999e-576cf58c3525-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.112522 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.112502 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dpt\" (UniqueName: \"kubernetes.io/projected/35d39d35-55cf-48f2-999e-576cf58c3525-kube-api-access-v5dpt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9mzn8\" (UID: \"35d39d35-55cf-48f2-999e-576cf58c3525\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.191022 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.190990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:43.323167 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.323146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8"] Jun 07 09:21:43.325888 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:21:43.325859 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d39d35_55cf_48f2_999e_576cf58c3525.slice/crio-9d67b2143961cb1e25aefee2666708c84a6b3305a3a7673cc0bd55de55e35243 WatchSource:0}: Error finding container 9d67b2143961cb1e25aefee2666708c84a6b3305a3a7673cc0bd55de55e35243: Status 404 returned error can't find the container with id 9d67b2143961cb1e25aefee2666708c84a6b3305a3a7673cc0bd55de55e35243 Jun 07 09:21:43.327887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.327869 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 09:21:43.435089 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.435058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" event={"ID":"35d39d35-55cf-48f2-999e-576cf58c3525","Type":"ContainerStarted","Data":"9d67b2143961cb1e25aefee2666708c84a6b3305a3a7673cc0bd55de55e35243"} Jun 07 09:21:43.485767 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:43.485691 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:21:47.458877 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:47.458844 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" event={"ID":"35d39d35-55cf-48f2-999e-576cf58c3525","Type":"ContainerStarted","Data":"08462b246826e728d3c293724aaa4d7dbb50cf3f54050be518ea51e4fdfc1d1b"} Jun 07 09:21:48.892470 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:48.892431 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:21:49.468072 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:49.468038 2573 generic.go:356] "Generic (PLEG): container finished" podID="35d39d35-55cf-48f2-999e-576cf58c3525" containerID="08462b246826e728d3c293724aaa4d7dbb50cf3f54050be518ea51e4fdfc1d1b" exitCode=0 Jun 07 09:21:49.468224 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:49.468112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" event={"ID":"35d39d35-55cf-48f2-999e-576cf58c3525","Type":"ContainerDied","Data":"08462b246826e728d3c293724aaa4d7dbb50cf3f54050be518ea51e4fdfc1d1b"} Jun 07 09:21:51.478101 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:51.478064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" event={"ID":"35d39d35-55cf-48f2-999e-576cf58c3525","Type":"ContainerStarted","Data":"eb2a34963f5c2f5bbcbee40ae2706820558a800c5331ba187f0557f6d865f1c8"} Jun 07 09:21:51.498041 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:51.497990 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" podStartSLOduration=2.895641223 podStartE2EDuration="9.497974505s" totalImagesPullingTime="4.51497602s" totalInitContainerRuntime="2.087357262s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:21:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:21:51.495455224 +0000 UTC m=+813.632325338" watchObservedRunningTime="2026-06-07 09:21:51.497974505 +0000 UTC m=+813.634844584" Jun 07 09:21:53.191441 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:53.191406 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:53.191804 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:53.191697 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:53.203825 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:53.203804 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:53.498598 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:53.498518 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9mzn8" Jun 07 09:21:55.690924 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:21:55.690891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:22:05.591185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:05.591150 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:22:10.271115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.271076 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr"] Jun 07 09:22:10.275283 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.275260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.277178 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.277153 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 07 09:22:10.285920 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.285899 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr"] Jun 07 09:22:10.330342 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wd4\" (UniqueName: \"kubernetes.io/projected/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kube-api-access-m4wd4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.330538 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.330538 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.330538 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.330673 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.330673 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.330598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.430998 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.430962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wd4\" (UniqueName: \"kubernetes.io/projected/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kube-api-access-m4wd4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431723 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431841 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.431841 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.431744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.434075 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.434047 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.434274 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.434253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.438265 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.438232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wd4\" (UniqueName: \"kubernetes.io/projected/fcc26ee9-0f5b-4470-8a3c-4624b9dd983a-kube-api-access-m4wd4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gcvbr\" (UID: \"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.587243 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.587165 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:10.716651 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:10.716601 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr"] Jun 07 09:22:10.718817 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:22:10.718789 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc26ee9_0f5b_4470_8a3c_4624b9dd983a.slice/crio-4073e8a3d97c2279255c26d2d3bdbc886c0956513da1d54c030eb6b5342a4450 WatchSource:0}: Error finding container 4073e8a3d97c2279255c26d2d3bdbc886c0956513da1d54c030eb6b5342a4450: Status 404 returned error can't find the container with id 4073e8a3d97c2279255c26d2d3bdbc886c0956513da1d54c030eb6b5342a4450 Jun 07 09:22:11.281864 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:11.281830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:22:11.569078 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:11.568999 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" event={"ID":"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a","Type":"ContainerStarted","Data":"ab51cb2bbed6211f330f6b4916fc816c2543c004032c30590301fdfd20b2fc72"} Jun 07 09:22:11.569078 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:11.569047 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" event={"ID":"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a","Type":"ContainerStarted","Data":"4073e8a3d97c2279255c26d2d3bdbc886c0956513da1d54c030eb6b5342a4450"} Jun 07 09:22:12.574336 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:12.574281 2573 generic.go:356] "Generic (PLEG): container finished" podID="fcc26ee9-0f5b-4470-8a3c-4624b9dd983a" containerID="ab51cb2bbed6211f330f6b4916fc816c2543c004032c30590301fdfd20b2fc72" exitCode=0 Jun 07 09:22:12.574822 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:12.574376 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" event={"ID":"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a","Type":"ContainerDied","Data":"ab51cb2bbed6211f330f6b4916fc816c2543c004032c30590301fdfd20b2fc72"} Jun 07 09:22:13.580338 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:13.580292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" event={"ID":"fcc26ee9-0f5b-4470-8a3c-4624b9dd983a","Type":"ContainerStarted","Data":"5a6c9847e4c6161191166b3e19ac199c6fafd1cede850f36e18c215fbf5d6179"} Jun 07 09:22:13.597547 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:13.597499 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" podStartSLOduration=2.295737461 podStartE2EDuration="3.597485345s" totalImagesPullingTime="148.015269ms" totalInitContainerRuntime="1.153732615s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:22:13.595609592 +0000 UTC m=+835.732479670" watchObservedRunningTime="2026-06-07 09:22:13.597485345 +0000 UTC m=+835.734355423" Jun 07 09:22:20.588237 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:20.588190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:20.588718 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:20.588302 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:20.605403 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:20.605380 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:22:20.620681 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:22:20.620659 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gcvbr" Jun 07 09:23:18.297606 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:23:18.297527 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:23:18.299676 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:23:18.299651 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:24:08.783551 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:08.783516 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:24:19.382007 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:19.381971 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:24:28.592630 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:28.592594 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:24:38.997423 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:38.997339 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:24:47.285894 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:47.285858 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:24:57.889414 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:24:57.889385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:25:30.624493 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:25:30.624463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:25:34.482967 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:25:34.482931 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:25:41.688859 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:25:41.688821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:25:44.286528 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:25:44.286491 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:26:12.986217 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:26:12.986135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:26:29.282156 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:26:29.282119 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:27:07.583177 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:27:07.583142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:27:24.588624 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:27:24.588592 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:27:38.184974 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:27:38.184897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:27:53.679225 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:27:53.679189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:27:56.583808 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:27:56.583756 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:28:18.325458 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:28:18.325433 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:28:18.327823 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:28:18.327802 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:28:32.484037 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:28:32.484006 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:28:35.877476 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:28:35.877438 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:28:57.786185 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:28:57.786144 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:29:07.092972 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:29:07.092889 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:29:23.584422 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:29:23.584387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:29:32.590221 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:29:32.590182 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:29:49.398603 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:29:49.398560 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:29:57.590088 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:29:57.590053 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:30:30.384074 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:30:30.383995 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:30:38.389959 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:30:38.389922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:30:41.381058 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:30:41.381023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:30:47.684107 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:30:47.684067 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:30:55.579590 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:30:55.579552 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:31:04.179797 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:31:04.179762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:31:12.185775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:31:12.185740 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:31:14.980392 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:31:14.980360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:31:21.090040 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:31:21.090009 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:31:32.288338 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:31:32.288297 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:09.782360 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:09.782273 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:11.887186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:11.887149 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:19.295631 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:19.295601 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:22.788043 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:22.788005 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:30.782134 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:30.782100 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:39.690960 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:39.690926 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:49.397266 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:49.397230 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:32:57.380891 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:32:57.380860 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:05.578698 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:05.578661 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:08.386938 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:08.386904 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:14.984887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:14.984846 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:18.355653 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:18.355620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:33:18.357756 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:18.357733 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:33:23.415303 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:23.415269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:32.388634 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:32.388552 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:41.187781 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:41.187743 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:49.789540 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:49.789509 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:33:58.685604 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:33:58.685573 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:34:06.985507 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:34:06.985474 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:34:16.986414 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:34:16.986378 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:34:24.185585 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:34:24.185554 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:34:34.083398 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:34:34.083366 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:34:41.988471 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:34:41.988438 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:36:58.892395 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:36:58.892302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:37:04.778744 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:37:04.778703 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:37:31.190432 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:37:31.190396 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:37:35.591692 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:37:35.591660 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:37:45.683009 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:37:45.682976 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:37:55.184487 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:37:55.184451 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:04.685033 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:04.684953 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:14.986869 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:14.986832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:18.383253 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:18.383220 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:38:18.386777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:18.386753 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:38:24.185774 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:24.185741 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:33.877266 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:33.877230 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:43.484447 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:43.484416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:38:53.092158 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:38:53.092121 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:39:01.981623 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:39:01.981590 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:39:04.987386 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:39:04.987348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:39:35.490491 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:39:35.490411 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:40:17.791287 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:40:17.791248 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:40:26.784537 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:40:26.784502 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:40:36.293242 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:40:36.293208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:40:44.080403 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:40:44.080371 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:40:54.285272 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:40:54.285239 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:05.792538 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:05.792460 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:14.382032 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:14.382000 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:20.136290 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:20.136254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:29.480798 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:29.480765 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:37.288589 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:37.288551 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:45.321697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:45.321659 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:41:55.781713 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:41:55.781677 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:42:14.189623 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:42:14.189590 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:42:22.484740 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:42:22.484707 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:42:31.787348 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:42:31.785589 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:42:39.180660 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:42:39.180622 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:42:56.829797 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:42:56.829762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:05.294733 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:05.294698 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:14.280398 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:14.280350 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:18.409621 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:18.409592 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:43:18.415540 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:18.415521 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:43:21.633359 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:21.633312 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:31.784863 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:31.784830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:39.381403 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:39.381369 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:43:49.688793 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:43:49.688755 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:02.783271 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:02.783227 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:11.884711 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:11.884679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:22.093374 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:22.093338 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:25.285221 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:25.285188 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:33.182700 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:33.182663 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:37.087763 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:37.087725 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:48.080038 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:48.079997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:44:54.287128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:44:54.287092 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:45:10.879670 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:45:10.879637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:45:19.690740 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:45:19.690706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:45:28.482518 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:45:28.482483 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:45:34.482198 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:45:34.482119 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:45:58.188097 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:45:58.188060 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:46:11.284514 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.284475 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:46:11.687358 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.687303 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:11.692288 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.692260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.695186 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.695159 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-78722715-openshift-default-dockercfg-cpqx4\"" Jun 07 09:46:11.702209 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.702186 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:11.877901 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.877872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878067 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.877906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878067 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.877926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878067 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.877960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878067 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.878040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878234 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.878084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878234 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.878113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878234 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.878129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.878234 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.878148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5pl8\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979544 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979544 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979544 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5pl8\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.979799 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.980115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.979976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.980115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.980034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.980115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.980073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.980272 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.980162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.980445 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.980426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.981776 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.981758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.982156 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.982137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.987369 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.987347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5pl8\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:11.987466 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:11.987387 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token\") pod \"e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:12.004212 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.004193 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:12.136465 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.136386 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:12.139104 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:46:12.139076 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cd76ea_67b0_48a8_8f93_875e2209eb06.slice/crio-3d19557d588e320306f16930b6355386b8509306a18fc885176277999c38ae29 WatchSource:0}: Error finding container 3d19557d588e320306f16930b6355386b8509306a18fc885176277999c38ae29: Status 404 returned error can't find the container with id 3d19557d588e320306f16930b6355386b8509306a18fc885176277999c38ae29 Jun 07 09:46:12.141672 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.141632 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:12.141774 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.141718 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:12.141774 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.141758 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:12.923846 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.923804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" event={"ID":"75cd76ea-67b0-48a8-8f93-875e2209eb06","Type":"ContainerStarted","Data":"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19"} Jun 07 09:46:12.924219 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.923867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" event={"ID":"75cd76ea-67b0-48a8-8f93-875e2209eb06","Type":"ContainerStarted","Data":"3d19557d588e320306f16930b6355386b8509306a18fc885176277999c38ae29"} Jun 07 09:46:12.942485 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:12.942439 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" podStartSLOduration=1.942425403 podStartE2EDuration="1.942425403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:46:12.940250736 +0000 UTC m=+2275.077120816" watchObservedRunningTime="2026-06-07 09:46:12.942425403 +0000 UTC m=+2275.079295482" Jun 07 09:46:13.005146 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:13.005118 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:13.009855 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:13.009835 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:13.928193 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:13.928163 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:13.929075 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:13.929053 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:15.083177 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:15.083142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m4vjd"] Jun 07 09:46:18.102748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:18.102711 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:18.103197 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:18.102879 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" podUID="75cd76ea-67b0-48a8-8f93-875e2209eb06" containerName="istio-proxy" containerID="cri-o://a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19" gracePeriod=30 Jun 07 09:46:23.349359 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.349315 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:23.374861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374789 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.374861 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374841 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375034 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374898 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375034 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374925 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375034 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375034 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374974 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375034 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.374997 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375267 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375080 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5pl8\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375267 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375084 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:23.375267 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375145 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data\") pod \"75cd76ea-67b0-48a8-8f93-875e2209eb06\" (UID: \"75cd76ea-67b0-48a8-8f93-875e2209eb06\") " Jun 07 09:46:23.375431 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375372 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:23.375490 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375427 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:23.375626 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375591 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-credential-socket\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.375626 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375617 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-socket\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.375748 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375632 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-workload-certs\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.376051 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375804 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data" (OuterVolumeSpecName: "istio-data") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:23.376051 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.375894 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:46:23.377412 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.377389 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token" (OuterVolumeSpecName: "istio-token") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:46:23.377632 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.377609 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:23.377703 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.377617 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8" (OuterVolumeSpecName: "kube-api-access-v5pl8") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "kube-api-access-v5pl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:46:23.377756 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.377741 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75cd76ea-67b0-48a8-8f93-875e2209eb06" (UID: "75cd76ea-67b0-48a8-8f93-875e2209eb06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 07 09:46:23.476511 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476482 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-data\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.476511 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476508 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-envoy\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.476671 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476519 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-podinfo\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.476671 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476532 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75cd76ea-67b0-48a8-8f93-875e2209eb06-istiod-ca-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.476671 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476543 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-istio-token\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.476671 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.476553 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5pl8\" (UniqueName: \"kubernetes.io/projected/75cd76ea-67b0-48a8-8f93-875e2209eb06-kube-api-access-v5pl8\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:23.973696 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.973660 2573 generic.go:356] "Generic (PLEG): container finished" podID="75cd76ea-67b0-48a8-8f93-875e2209eb06" containerID="a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19" exitCode=0 Jun 07 09:46:23.973869 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.973707 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" Jun 07 09:46:23.973869 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.973747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" event={"ID":"75cd76ea-67b0-48a8-8f93-875e2209eb06","Type":"ContainerDied","Data":"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19"} Jun 07 09:46:23.973869 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.973798 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9" event={"ID":"75cd76ea-67b0-48a8-8f93-875e2209eb06","Type":"ContainerDied","Data":"3d19557d588e320306f16930b6355386b8509306a18fc885176277999c38ae29"} Jun 07 09:46:23.973869 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.973820 2573 scope.go:117] "RemoveContainer" containerID="a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19" Jun 07 09:46:23.983514 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.983499 2573 scope.go:117] "RemoveContainer" containerID="a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19" Jun 07 09:46:23.983785 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:46:23.983766 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19\": container with ID starting with a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19 not found: ID does not exist" containerID="a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19" Jun 07 09:46:23.983837 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.983794 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19"} err="failed to get container status \"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19\": rpc error: code = NotFound desc = could not find container \"a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19\": container with ID starting with a1144ebc770416daaa04a8ad028bd005f18c5bb7d136e3ca22296c5c3ee32e19 not found: ID does not exist" Jun 07 09:46:23.993867 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.993842 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:23.999288 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:23.999266 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-78722715-openshift-default-5d44476fb4-vsbh9"] Jun 07 09:46:24.068665 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.068630 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:24.069010 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.068994 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cd76ea-67b0-48a8-8f93-875e2209eb06" containerName="istio-proxy" Jun 07 09:46:24.069010 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.069010 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cd76ea-67b0-48a8-8f93-875e2209eb06" containerName="istio-proxy" Jun 07 09:46:24.069158 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.069094 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cd76ea-67b0-48a8-8f93-875e2209eb06" containerName="istio-proxy" Jun 07 09:46:24.073569 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.073546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.075335 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.075304 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-23910b71-openshift-default-dockercfg-8h8s6\"" Jun 07 09:46:24.084561 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.084540 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:24.182136 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czq7h\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182299 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182499 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182499 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182499 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.182499 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.182405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.282868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czq7h\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.282868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.282868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283126 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283126 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283126 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.282945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283263 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283263 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283385 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283385 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283522 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283494 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283662 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283662 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.283850 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.283701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.285849 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.285823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.286133 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.286109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.291801 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.291777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czq7h\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.292137 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.292118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token\") pod \"e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.303204 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.303178 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75cd76ea-67b0-48a8-8f93-875e2209eb06" path="/var/lib/kubelet/pods/75cd76ea-67b0-48a8-8f93-875e2209eb06/volumes" Jun 07 09:46:24.386428 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.386405 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:24.516459 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.516419 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:24.523348 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:46:24.523273 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc957fe80_f4cb_4f4f_aeb3_e9da6661c70c.slice/crio-efef92cbc5352f4c7baadfc9dc9b6227b5cc03adc43f486c8dcc7474f103a80f WatchSource:0}: Error finding container efef92cbc5352f4c7baadfc9dc9b6227b5cc03adc43f486c8dcc7474f103a80f: Status 404 returned error can't find the container with id efef92cbc5352f4c7baadfc9dc9b6227b5cc03adc43f486c8dcc7474f103a80f Jun 07 09:46:24.525576 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.525538 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:24.525648 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.525620 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:24.525688 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.525661 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 07 09:46:24.979609 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.979571 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" event={"ID":"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c","Type":"ContainerStarted","Data":"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e"} Jun 07 09:46:24.979777 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.979639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" event={"ID":"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c","Type":"ContainerStarted","Data":"efef92cbc5352f4c7baadfc9dc9b6227b5cc03adc43f486c8dcc7474f103a80f"} Jun 07 09:46:24.998044 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:24.997991 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" podStartSLOduration=0.997975126 podStartE2EDuration="997.975126ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:46:24.996138087 +0000 UTC m=+2287.133008166" watchObservedRunningTime="2026-06-07 09:46:24.997975126 +0000 UTC m=+2287.134845205" Jun 07 09:46:25.387280 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:25.387199 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:25.391893 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:25.391870 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:25.985113 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:25.985088 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:25.986091 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:25.986067 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:31.464081 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:31.464037 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:31.464549 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:31.464247 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" podUID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" containerName="istio-proxy" containerID="cri-o://fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e" gracePeriod=30 Jun 07 09:46:36.709834 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.709812 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:36.797573 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797504 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797573 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797559 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797770 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797587 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797770 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797640 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czq7h\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797770 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797667 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797770 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797690 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797945 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797797 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:36.797945 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797847 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797945 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.797945 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797889 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:36.798137 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.797954 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket\") pod \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\" (UID: \"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c\") " Jun 07 09:46:36.798137 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798003 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:36.798137 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798094 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 09:46:36.798292 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798274 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:36.798478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798399 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istiod-ca-cert\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.798478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798422 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-credential-socket\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.798478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798438 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-socket\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.798478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798453 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-data\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.798478 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.798466 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-workload-certs\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.799839 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.799811 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 07 09:46:36.799951 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.799918 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h" (OuterVolumeSpecName: "kube-api-access-czq7h") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "kube-api-access-czq7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:46:36.800039 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.800024 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 09:46:36.800076 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.800045 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" (UID: "c957fe80-f4cb-4f4f-aeb3-e9da6661c70c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 09:46:36.899641 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.899610 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czq7h\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-kube-api-access-czq7h\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.899641 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.899635 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-token\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.899641 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.899644 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-envoy\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:36.899833 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:36.899652 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c-istio-podinfo\") on node \"ip-10-0-134-51.ec2.internal\" DevicePath \"\"" Jun 07 09:46:37.037227 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.037190 2573 generic.go:356] "Generic (PLEG): container finished" podID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" containerID="fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e" exitCode=0 Jun 07 09:46:37.037400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.037240 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" Jun 07 09:46:37.037400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.037281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" event={"ID":"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c","Type":"ContainerDied","Data":"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e"} Jun 07 09:46:37.037400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.037361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg" event={"ID":"c957fe80-f4cb-4f4f-aeb3-e9da6661c70c","Type":"ContainerDied","Data":"efef92cbc5352f4c7baadfc9dc9b6227b5cc03adc43f486c8dcc7474f103a80f"} Jun 07 09:46:37.037400 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.037391 2573 scope.go:117] "RemoveContainer" containerID="fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e" Jun 07 09:46:37.046497 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.046482 2573 scope.go:117] "RemoveContainer" containerID="fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e" Jun 07 09:46:37.046732 ip-10-0-134-51 kubenswrapper[2573]: E0607 09:46:37.046713 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e\": container with ID starting with fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e not found: ID does not exist" containerID="fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e" Jun 07 09:46:37.046768 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.046740 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e"} err="failed to get container status \"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e\": rpc error: code = NotFound desc = could not find container \"fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e\": container with ID starting with fac234f44c0e5018ec35d9b9295437ff4c90ccc893224fb20ecd8682ba82413e not found: ID does not exist" Jun 07 09:46:37.056916 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.056871 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:37.060209 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:37.060188 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-23910b71-openshift-default-5bd5494b4d-7r5kg"] Jun 07 09:46:38.301694 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:38.301659 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" path="/var/lib/kubelet/pods/c957fe80-f4cb-4f4f-aeb3-e9da6661c70c/volumes" Jun 07 09:46:49.084693 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:49.084666 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8f57c774b-dl5kp_9af296f2-0f00-4640-90ea-c92eca1a74cc/nginx/0.log" Jun 07 09:46:50.191092 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:50.191065 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84c76964bf-5psvf_0ad9f4b6-9303-4043-b6aa-e68bb175600b/copy-manifests/0.log" Jun 07 09:46:50.210361 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:50.210310 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84c76964bf-5psvf_0ad9f4b6-9303-4043-b6aa-e68bb175600b/manager/0.log" Jun 07 09:46:51.864661 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:51.864623 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-db2nk_33fe47b7-7992-4b09-b2d5-9f54bfc6f850/manager/0.log" Jun 07 09:46:52.096045 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:52.096015 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fmxxg_80ea6d58-95cc-49f9-af1d-7bc577597529/kuadrant-console-plugin/0.log" Jun 07 09:46:52.214829 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:52.214794 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-296kv_3d67a13c-e10e-485d-a588-039f3ba0c7b2/registry-server/0.log" Jun 07 09:46:52.446934 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:52.446906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m4vjd_a4749108-1be7-4ea7-b000-3e494a6559ec/limitador/0.log" Jun 07 09:46:52.563296 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:52.563214 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-p94qn_4cbe979d-306a-4e9c-974d-1a4570692c97/manager/0.log" Jun 07 09:46:52.899697 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:52.899609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795677m9_e5fe0b70-3682-4394-9ef7-e5e147ddc36d/istio-proxy/0.log" Jun 07 09:46:54.126568 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:54.126536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9mzn8_35d39d35-55cf-48f2-999e-576cf58c3525/storage-initializer/0.log" Jun 07 09:46:54.134995 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:54.134968 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9mzn8_35d39d35-55cf-48f2-999e-576cf58c3525/main/0.log" Jun 07 09:46:54.581404 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:54.581371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gcvbr_fcc26ee9-0f5b-4470-8a3c-4624b9dd983a/storage-initializer/0.log" Jun 07 09:46:54.588800 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:54.588770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gcvbr_fcc26ee9-0f5b-4470-8a3c-4624b9dd983a/main/0.log" Jun 07 09:46:58.182856 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.180079 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jfwxs/must-gather-vrxnt"] Jun 07 09:46:58.182856 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.180832 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" containerName="istio-proxy" Jun 07 09:46:58.182856 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.180854 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" containerName="istio-proxy" Jun 07 09:46:58.182856 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.181029 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c957fe80-f4cb-4f4f-aeb3-e9da6661c70c" containerName="istio-proxy" Jun 07 09:46:58.185106 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.185078 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.187001 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.186975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jfwxs\"/\"default-dockercfg-nh8jc\"" Jun 07 09:46:58.187218 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.187201 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jfwxs\"/\"openshift-service-ca.crt\"" Jun 07 09:46:58.187501 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.187485 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jfwxs\"/\"kube-root-ca.crt\"" Jun 07 09:46:58.192948 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.192462 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jfwxs/must-gather-vrxnt"] Jun 07 09:46:58.286865 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.286834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qpdx\" (UniqueName: \"kubernetes.io/projected/61a3005a-8637-413b-92af-587c3b71d170-kube-api-access-4qpdx\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.286973 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.286868 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61a3005a-8637-413b-92af-587c3b71d170-must-gather-output\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.388187 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.388162 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qpdx\" (UniqueName: \"kubernetes.io/projected/61a3005a-8637-413b-92af-587c3b71d170-kube-api-access-4qpdx\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.388295 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.388195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61a3005a-8637-413b-92af-587c3b71d170-must-gather-output\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.388506 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.388491 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61a3005a-8637-413b-92af-587c3b71d170-must-gather-output\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.397623 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.397606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qpdx\" (UniqueName: \"kubernetes.io/projected/61a3005a-8637-413b-92af-587c3b71d170-kube-api-access-4qpdx\") pod \"must-gather-vrxnt\" (UID: \"61a3005a-8637-413b-92af-587c3b71d170\") " pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.495432 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.495379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" Jun 07 09:46:58.621003 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.620974 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jfwxs/must-gather-vrxnt"] Jun 07 09:46:58.625741 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:46:58.625705 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61a3005a_8637_413b_92af_587c3b71d170.slice/crio-f95cfecac64bcf2515e4445407fdbfe256d873a8fad2fce1be4b7267114cf271 WatchSource:0}: Error finding container f95cfecac64bcf2515e4445407fdbfe256d873a8fad2fce1be4b7267114cf271: Status 404 returned error can't find the container with id f95cfecac64bcf2515e4445407fdbfe256d873a8fad2fce1be4b7267114cf271 Jun 07 09:46:58.627846 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:58.627821 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 09:46:59.137644 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:46:59.137609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" event={"ID":"61a3005a-8637-413b-92af-587c3b71d170","Type":"ContainerStarted","Data":"f95cfecac64bcf2515e4445407fdbfe256d873a8fad2fce1be4b7267114cf271"} Jun 07 09:47:00.147184 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:00.147147 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" event={"ID":"61a3005a-8637-413b-92af-587c3b71d170","Type":"ContainerStarted","Data":"b734bd0f4ddca880fe93e03c66fd9bef77e07b1ba0779e629610c7c8ab6808d7"} Jun 07 09:47:00.147775 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:00.147750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" event={"ID":"61a3005a-8637-413b-92af-587c3b71d170","Type":"ContainerStarted","Data":"b2a5e4e89c45c8bba2796aad3065180d5e389e0550dce49e300e58cb24e6e67a"} Jun 07 09:47:00.164545 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:00.163190 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jfwxs/must-gather-vrxnt" podStartSLOduration=1.386321602 podStartE2EDuration="2.163166661s" totalImagesPullingTime="776.845059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 09:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:47:00.160975179 +0000 UTC m=+2322.297845258" watchObservedRunningTime="2026-06-07 09:47:00.163166661 +0000 UTC m=+2322.300036744" Jun 07 09:47:01.221335 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:01.221290 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xwp9z_2bb4d406-9fa8-4e9e-8e7c-09237bd4a618/global-pull-secret-syncer/0.log" Jun 07 09:47:01.313747 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:01.313708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vrntq_0b40fb1b-bdda-4ad9-8c6a-8ab7e3b4b700/konnectivity-agent/0.log" Jun 07 09:47:01.407104 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:01.407074 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-51.ec2.internal_d95acaf121a5db44d921cba276291dbe/haproxy/0.log" Jun 07 09:47:05.655711 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:05.655671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-db2nk_33fe47b7-7992-4b09-b2d5-9f54bfc6f850/manager/0.log" Jun 07 09:47:05.712115 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:05.712070 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fmxxg_80ea6d58-95cc-49f9-af1d-7bc577597529/kuadrant-console-plugin/0.log" Jun 07 09:47:05.749009 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:05.748976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-296kv_3d67a13c-e10e-485d-a588-039f3ba0c7b2/registry-server/0.log" Jun 07 09:47:05.846742 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:05.846711 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m4vjd_a4749108-1be7-4ea7-b000-3e494a6559ec/limitador/0.log" Jun 07 09:47:05.948955 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:05.948915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-p94qn_4cbe979d-306a-4e9c-974d-1a4570692c97/manager/0.log" Jun 07 09:47:07.829155 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.829062 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/alertmanager/0.log" Jun 07 09:47:07.863457 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.863401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/config-reloader/0.log" Jun 07 09:47:07.888179 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.888148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/kube-rbac-proxy-web/0.log" Jun 07 09:47:07.912051 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.912011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/kube-rbac-proxy/0.log" Jun 07 09:47:07.936843 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.936815 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/kube-rbac-proxy-metric/0.log" Jun 07 09:47:07.962128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.962101 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/prom-label-proxy/0.log" Jun 07 09:47:07.985534 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:07.985509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2e2f34f-3b07-4699-882d-2993c22a9962/init-config-reloader/0.log" Jun 07 09:47:08.196044 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.196012 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7828r_ab23b030-b022-47aa-95f8-f2f86943a9e1/node-exporter/0.log" Jun 07 09:47:08.238391 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.238266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7828r_ab23b030-b022-47aa-95f8-f2f86943a9e1/kube-rbac-proxy/0.log" Jun 07 09:47:08.279914 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.279889 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7828r_ab23b030-b022-47aa-95f8-f2f86943a9e1/init-textfile/0.log" Jun 07 09:47:08.859795 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.859760 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-mmf5k_af4bac35-f322-4943-ac98-6d3e391262bf/prometheus-operator-admission-webhook/0.log" Jun 07 09:47:08.902617 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.902588 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b467d8fd8-8q82d_c2d0fc38-a2df-454e-bd1c-afa816367099/telemeter-client/0.log" Jun 07 09:47:08.955692 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:08.955657 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b467d8fd8-8q82d_c2d0fc38-a2df-454e-bd1c-afa816367099/reload/0.log" Jun 07 09:47:09.001813 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:09.001781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b467d8fd8-8q82d_c2d0fc38-a2df-454e-bd1c-afa816367099/kube-rbac-proxy/0.log" Jun 07 09:47:12.036350 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:12.036284 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f6d677c-xp2pr_66412ba7-bae8-43a3-8d96-46fa3859305c/console/0.log" Jun 07 09:47:13.467868 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.467834 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4"] Jun 07 09:47:13.474072 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.474040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.479422 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.478698 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4"] Jun 07 09:47:13.542887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.542470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-proc\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.542887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.542520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-sys\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.542887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.542563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-podres\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.542887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.542687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-lib-modules\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.542887 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.542759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmb6\" (UniqueName: \"kubernetes.io/projected/39bdd723-2677-4e2f-9c1e-8790596bfd3d-kube-api-access-twmb6\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.643988 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.643948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmb6\" (UniqueName: \"kubernetes.io/projected/39bdd723-2677-4e2f-9c1e-8790596bfd3d-kube-api-access-twmb6\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.644251 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-proc\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.644422 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-sys\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.644592 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-podres\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.644741 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-lib-modules\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.644974 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-lib-modules\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.645071 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-proc\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.645227 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.645214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-podres\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.645297 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.644504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39bdd723-2677-4e2f-9c1e-8790596bfd3d-sys\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.651610 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.651585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmb6\" (UniqueName: \"kubernetes.io/projected/39bdd723-2677-4e2f-9c1e-8790596bfd3d-kube-api-access-twmb6\") pod \"perf-node-gather-daemonset-ntml4\" (UID: \"39bdd723-2677-4e2f-9c1e-8790596bfd3d\") " pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.790794 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.790699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:13.969846 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:13.969813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4"] Jun 07 09:47:13.973081 ip-10-0-134-51 kubenswrapper[2573]: W0607 09:47:13.973050 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39bdd723_2677_4e2f_9c1e_8790596bfd3d.slice/crio-ed7b7cefe303341ec51874bb25bb12508379791fbcaf9007a32b4e36dbff7576 WatchSource:0}: Error finding container ed7b7cefe303341ec51874bb25bb12508379791fbcaf9007a32b4e36dbff7576: Status 404 returned error can't find the container with id ed7b7cefe303341ec51874bb25bb12508379791fbcaf9007a32b4e36dbff7576 Jun 07 09:47:14.060384 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.060294 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvqmb_ad605592-d021-490f-923d-c82b69d08d5d/dns/0.log" Jun 07 09:47:14.081070 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.081039 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvqmb_ad605592-d021-490f-923d-c82b69d08d5d/kube-rbac-proxy/0.log" Jun 07 09:47:14.127063 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.127029 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f4x4t_6ad85837-4cce-431b-bd65-91545c75bed8/dns-node-resolver/0.log" Jun 07 09:47:14.244038 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.243996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" event={"ID":"39bdd723-2677-4e2f-9c1e-8790596bfd3d","Type":"ContainerStarted","Data":"af330120701f29b5ed8150b75b5c4bacb435f3533116561208747884cc473925"} Jun 07 09:47:14.244217 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.244104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" event={"ID":"39bdd723-2677-4e2f-9c1e-8790596bfd3d","Type":"ContainerStarted","Data":"ed7b7cefe303341ec51874bb25bb12508379791fbcaf9007a32b4e36dbff7576"} Jun 07 09:47:14.244217 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.244135 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:14.260175 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.260111 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" podStartSLOduration=1.260089115 podStartE2EDuration="1.260089115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 09:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 09:47:14.257243441 +0000 UTC m=+2336.394113520" watchObservedRunningTime="2026-06-07 09:47:14.260089115 +0000 UTC m=+2336.396959196" Jun 07 09:47:14.745253 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:14.745219 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x29gk_b3f8936d-8b23-47cb-9c6e-3e5e9d02f849/node-ca/0.log" Jun 07 09:47:15.662542 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:15.662485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795677m9_e5fe0b70-3682-4394-9ef7-e5e147ddc36d/istio-proxy/0.log" Jun 07 09:47:16.652383 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:16.652350 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r69v_ae78a710-9da2-48a9-96bc-f9c2a7e6a708/serve-healthcheck-canary/0.log" Jun 07 09:47:17.331585 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:17.331557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tk48s_0d8d7495-d4bd-4d8d-9f28-18fac91c42c2/kube-rbac-proxy/0.log" Jun 07 09:47:17.352700 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:17.352675 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tk48s_0d8d7495-d4bd-4d8d-9f28-18fac91c42c2/exporter/0.log" Jun 07 09:47:17.374603 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:17.374569 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tk48s_0d8d7495-d4bd-4d8d-9f28-18fac91c42c2/extractor/0.log" Jun 07 09:47:19.486506 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:19.486466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8f57c774b-dl5kp_9af296f2-0f00-4640-90ea-c92eca1a74cc/nginx/0.log" Jun 07 09:47:20.107715 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:20.107686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84c76964bf-5psvf_0ad9f4b6-9303-4043-b6aa-e68bb175600b/manager/0.log" Jun 07 09:47:20.124970 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:20.124942 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84c76964bf-5psvf_0ad9f4b6-9303-4043-b6aa-e68bb175600b/copy-manifests/0.log" Jun 07 09:47:20.263909 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:20.263878 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jfwxs/perf-node-gather-daemonset-ntml4" Jun 07 09:47:21.732757 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:21.732728 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-867d454bbd-tgr8s_d9363b43-373d-46ca-9964-af24ac479cb6/manager/0.log" Jun 07 09:47:26.166580 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:26.166543 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795677m9_e5fe0b70-3682-4394-9ef7-e5e147ddc36d/istio-proxy/0.log" Jun 07 09:47:27.555584 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:27.555546 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795677m9_e5fe0b70-3682-4394-9ef7-e5e147ddc36d/istio-proxy/0.log" Jun 07 09:47:29.052025 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.052002 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/kube-multus-additional-cni-plugins/0.log" Jun 07 09:47:29.074897 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.074859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/egress-router-binary-copy/0.log" Jun 07 09:47:29.097145 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.097105 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/cni-plugins/0.log" Jun 07 09:47:29.120408 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.120380 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/bond-cni-plugin/0.log" Jun 07 09:47:29.141744 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.141717 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/routeoverride-cni/0.log" Jun 07 09:47:29.163466 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.163428 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/whereabouts-cni-bincopy/0.log" Jun 07 09:47:29.185483 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.185454 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spxgp_7c68b534-359f-4980-bda0-e1303dbe4c85/whereabouts-cni/0.log" Jun 07 09:47:29.435772 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.435741 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sm6ds_42a6f693-2438-4166-8b76-8b0f4836cec0/kube-multus/0.log" Jun 07 09:47:29.456895 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.456868 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n9bfz_c3d060d6-7deb-42f9-afc5-95a1a7d835ae/network-metrics-daemon/0.log" Jun 07 09:47:29.476762 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.476731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n9bfz_c3d060d6-7deb-42f9-afc5-95a1a7d835ae/kube-rbac-proxy/0.log" Jun 07 09:47:29.588143 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:29.588109 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795677m9_e5fe0b70-3682-4394-9ef7-e5e147ddc36d/istio-proxy/0.log" Jun 07 09:47:30.901128 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.901098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-controller/0.log" Jun 07 09:47:30.927536 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.927507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/0.log" Jun 07 09:47:30.927798 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.927708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/ovn-acl-logging/1.log" Jun 07 09:47:30.953446 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.953416 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/kube-rbac-proxy-node/0.log" Jun 07 09:47:30.978438 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.978407 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/kube-rbac-proxy-ovn-metrics/0.log" Jun 07 09:47:30.995634 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:30.995604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/northd/0.log" Jun 07 09:47:31.020481 ip-10-0-134-51 kubenswrapper[2573]: I0607 09:47:31.020451 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llkrp_ad747180-0808-4e1f-b28b-8e7773c9f2ce/nbdb/0.log"