Jul 06 13:44:55.779043 ip-10-0-143-72 systemd[1]: Starting Kubernetes Kubelet... Jul 06 13:44:56.189794 ip-10-0-143-72 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:44:56.189794 ip-10-0-143-72 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 13:44:56.189794 ip-10-0-143-72 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:44:56.189794 ip-10-0-143-72 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 13:44:56.189794 ip-10-0-143-72 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:44:56.190490 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.189868 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 13:44:56.195806 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195788 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.195806 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195803 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.195806 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195807 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195810 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195815 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195818 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195821 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195824 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195827 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195830 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195833 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195836 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195838 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195841 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195843 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195846 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195849 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195851 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195854 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195856 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195859 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195862 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.195891 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195864 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195870 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195873 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195875 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195878 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195880 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195883 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195886 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195889 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195891 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195894 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195897 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195900 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195903 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195906 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195909 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195912 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195914 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195917 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195919 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.196360 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195924 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195928 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195931 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195934 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195937 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195940 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195943 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195946 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195949 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195952 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195954 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195957 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195960 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195962 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195965 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195968 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195972 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195975 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195978 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.196852 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195985 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195988 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195990 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195993 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195996 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.195998 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196003 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196006 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196008 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196012 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196014 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196017 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196019 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196022 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196027 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196030 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196033 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196035 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.197323 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196038 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196040 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196043 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196045 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196048 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196050 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196052 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196056 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196058 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196061 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196064 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196067 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196070 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196072 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196075 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196079 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196083 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196086 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196828 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.197789 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196835 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196838 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196841 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196844 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196847 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196849 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196852 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196856 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196861 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196864 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196867 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196870 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196873 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196875 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196878 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196881 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196883 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196885 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196888 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.198230 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196891 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196893 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196896 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196898 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196902 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196905 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196907 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196910 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196913 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196915 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196918 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196920 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196923 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196926 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196928 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196931 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196934 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196938 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196942 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.198714 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196945 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196948 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196950 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196953 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196957 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196959 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196962 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196964 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196967 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196969 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196972 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196974 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196977 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196980 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196983 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196986 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196989 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196992 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196995 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.196997 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.199174 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197001 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197005 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197008 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197011 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197014 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197017 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197020 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197023 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197025 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197028 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197030 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197033 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197035 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197038 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197040 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197043 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197046 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197049 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197051 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197055 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.199669 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197057 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197060 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197062 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197064 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197067 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197070 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197072 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197075 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197079 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197082 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197085 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197088 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197090 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197093 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197095 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197098 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197100 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197102 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197105 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197497 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.200160 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197502 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197505 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197509 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197512 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197516 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197518 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197521 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197524 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197527 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197530 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197533 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197536 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197538 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197541 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197543 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197546 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197548 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197551 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197554 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197557 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.200637 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197559 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197562 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197565 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197567 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197570 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197572 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197575 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197578 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197580 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197584 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197588 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197591 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197594 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197597 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197599 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197602 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197605 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197607 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197610 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.201146 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197613 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197616 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197618 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197622 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197624 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197627 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197630 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197633 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197638 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197641 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197644 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197646 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197649 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197651 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197654 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197657 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197659 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197662 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197665 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197667 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.201596 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197670 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197672 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197675 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197677 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197680 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197682 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197684 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197687 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197690 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197692 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197695 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197699 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197702 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197705 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197708 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197712 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197715 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197717 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197720 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.202072 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197722 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197725 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197728 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197730 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197733 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197735 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197738 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197755 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197758 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197761 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197763 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197766 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197768 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197771 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197773 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197776 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197778 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197781 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197783 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.197786 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.202552 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197852 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197858 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197865 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197869 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197874 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197879 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197886 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197892 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197897 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197901 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197905 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197911 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197915 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197918 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197921 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197924 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197928 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197930 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197935 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197937 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197941 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197944 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197947 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197951 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 13:44:56.203035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197954 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197957 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197960 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197963 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197966 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197969 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197972 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197975 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197980 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197982 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197985 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197988 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197991 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197994 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.197999 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198002 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198005 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198008 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198011 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198017 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198020 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198023 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198026 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198029 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198032 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 13:44:56.203605 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198035 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198038 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198040 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198043 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198047 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198050 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198055 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198058 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198061 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198064 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198067 2581 flags.go:64] FLAG: --help="false" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198070 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-72.ec2.internal" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198073 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198076 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198079 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198082 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198086 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198089 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198092 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198094 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198097 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198100 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198103 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198106 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 13:44:56.204279 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198109 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198111 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198115 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198119 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198122 2581 flags.go:64] FLAG: --lock-file="" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198125 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198128 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198131 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198136 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198138 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198141 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198144 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198147 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198150 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198155 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198158 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198162 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198165 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198168 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198172 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198175 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198177 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198181 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198183 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198186 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 13:44:56.204878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198189 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198196 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198199 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198202 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198205 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198207 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198213 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198216 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198219 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198221 2581 flags.go:64] FLAG: --port="10250" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198226 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198230 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076034cd9e44ca698" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198234 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198236 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198239 2581 flags.go:64] FLAG: --register-node="true" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198242 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198246 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198249 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198252 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198254 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198258 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198262 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198265 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198268 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198271 2581 flags.go:64] FLAG: --runonce="false" Jul 06 13:44:56.205600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198273 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198276 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198279 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198282 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198286 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198288 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198291 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198294 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198297 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198300 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198302 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198305 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198308 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198311 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198313 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198318 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198321 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198325 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198329 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198332 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198335 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198338 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198340 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198343 2581 flags.go:64] FLAG: --v="2" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198347 2581 flags.go:64] FLAG: --version="false" Jul 06 13:44:56.206227 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198351 2581 flags.go:64] FLAG: --vmodule="" Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198354 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.198357 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198479 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198483 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198486 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198489 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198493 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198496 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198499 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198502 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198505 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198507 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198510 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198512 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198515 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198518 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198520 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198523 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198525 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.206847 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198528 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198530 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198533 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198536 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198540 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198542 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198545 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198548 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198552 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198556 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198559 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198562 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198564 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198567 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198570 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198574 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198577 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198580 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198582 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198585 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.207363 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198587 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198590 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198592 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198595 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198597 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198600 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198602 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198605 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198607 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198610 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198612 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198615 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198617 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198619 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198622 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198629 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198631 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198634 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198636 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.207915 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198640 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198642 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198645 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198647 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198650 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198653 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198655 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198659 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198662 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198664 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198667 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198669 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198672 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198674 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198677 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198680 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198684 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198687 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198690 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198692 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.208390 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198694 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198697 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198700 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198702 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198705 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198707 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198710 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198712 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198716 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198719 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198722 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198724 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198727 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198730 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198733 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198735 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198738 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198754 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198758 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.208884 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198763 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198766 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.198769 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.199429 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.206690 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.206705 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.207491 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.207500 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207557 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207561 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207565 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207568 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207572 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207575 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.209340 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207577 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207580 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207583 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207585 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207590 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207594 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207597 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207600 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207603 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207606 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207609 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207612 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207615 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207618 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207621 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207623 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207627 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207630 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207632 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.209684 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207635 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207638 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207640 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207643 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207647 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207650 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207653 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207656 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207658 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207661 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207664 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207666 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207669 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207671 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207674 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207677 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207679 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207682 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207684 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207687 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.210149 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207689 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207692 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207694 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207697 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207699 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207702 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207704 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207707 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207709 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207712 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207714 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207717 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207720 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207722 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207725 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207727 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207731 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207734 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207736 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207739 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.210634 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207754 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207757 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207760 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207762 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207765 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207768 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207771 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207773 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207776 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207779 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207781 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207784 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207786 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207789 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207792 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207794 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207797 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207800 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207802 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.211118 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207805 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207807 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207810 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207812 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207815 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207819 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207822 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207824 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207827 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207831 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207834 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207848 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207851 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207854 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.211576 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207857 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.207862 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207975 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207979 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207983 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207986 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207989 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207992 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207995 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.207997 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208000 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208004 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208008 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208011 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:44:56.211937 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208014 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208017 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208019 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208022 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208025 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208028 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208030 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208033 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208035 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208038 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208042 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208045 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208048 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208051 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208054 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208056 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208060 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208062 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208065 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208067 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:44:56.212270 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208070 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208072 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208075 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208077 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208080 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208082 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208085 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208087 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208090 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208092 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208095 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208097 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208100 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208102 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208104 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208107 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208110 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208112 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208114 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208117 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:44:56.212761 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208119 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208122 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208124 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208127 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208129 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208132 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208135 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208138 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208140 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208143 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208146 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208148 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208151 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208153 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208156 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208158 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208161 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208163 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208166 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:44:56.213244 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208168 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208171 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208173 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208176 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208178 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208182 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208184 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208187 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208189 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208192 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208194 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208196 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208200 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208203 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208206 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208209 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208211 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208214 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208216 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208220 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:44:56.213702 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208222 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208225 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208227 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208230 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208233 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208236 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208238 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:56.208241 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.208245 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.208357 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.210528 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.211992 2581 server.go:1019] "Starting client certificate rotation" Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.212090 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:44:56.214177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.213095 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:44:56.215218 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.215203 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:44:56.219490 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.219464 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:44:56.231783 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.231764 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 13:44:56.233909 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.233895 2581 log.go:25] "Validated CRI v1 image API" Jul 06 13:44:56.234643 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.234621 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 13:44:56.237850 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.237830 2581 fs.go:135] Filesystem UUIDs: map[25952c96-90ef-4c35-9646-3e6b2b58f85c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 81e4d38c-04ab-4567-94e0-4ec1e22f0e8a:/dev/nvme0n1p3] Jul 06 13:44:56.237903 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.237850 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 13:44:56.242908 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.242789 2581 manager.go:216] Machine: {Timestamp:2026-07-06 13:44:56.241509847 +0000 UTC m=+0.345582391 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104168 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5fd33ba7384c3b220ed252b94f51 SystemUUID:ec2e5fd3-3ba7-384c-3b22-0ed252b94f51 BootID:5f8cf4a8-5904-43a7-b430-662b02b1f59b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:dc:00:0f:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:dc:00:0f:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:0c:9e:41:21:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 13:44:56.242908 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.242907 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 13:44:56.243037 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.243027 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 13:44:56.245453 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.245435 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:44:56.245896 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.245871 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 13:44:56.246069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.245905 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 13:44:56.246769 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.246738 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 13:44:56.246821 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.246776 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 13:44:56.246821 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.246786 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:44:56.247601 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.247588 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:44:56.249131 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.249119 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 13:44:56.252542 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252528 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:44:56.252674 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252663 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 13:44:56.252759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252702 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 13:44:56.252759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252717 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 13:44:56.252759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252732 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 13:44:56.252882 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252761 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 13:44:56.252882 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.252774 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 13:44:56.253278 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.253265 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:44:56.253341 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.253290 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:44:56.255365 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.255351 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 13:44:56.257185 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.257173 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 13:44:56.257223 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.257203 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 13:44:56.258479 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258468 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 13:44:56.258511 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258489 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 13:44:56.258538 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258528 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 13:44:56.258538 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258535 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258543 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258549 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258557 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258562 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258568 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258574 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 13:44:56.258587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258586 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 13:44:56.258789 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.258593 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 13:44:56.259311 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.259300 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 13:44:56.259344 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.259314 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 13:44:56.263825 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.263806 2581 server.go:1268] "Started kubelet" Jul 06 13:44:56.263936 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.263860 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 13:44:56.264335 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.264289 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 13:44:56.264497 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.264475 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 13:44:56.264811 ip-10-0-143-72 systemd[1]: Started Kubernetes Kubelet. Jul 06 13:44:56.265956 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.265800 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 13:44:56.266253 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.266197 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 13:44:56.266329 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.266309 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 13:44:56.266438 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.266410 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 13:44:56.269072 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.269057 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 13:44:56.271200 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.270322 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-72.ec2.internal.18bfb747c09622fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-72.ec2.internal,UID:ip-10-0-143-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-72.ec2.internal,},FirstTimestamp:2026-07-06 13:44:56.263631613 +0000 UTC m=+0.367704147,LastTimestamp:2026-07-06 13:44:56.263631613 +0000 UTC m=+0.367704147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-72.ec2.internal,}" Jul 06 13:44:56.271313 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.271289 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 13:44:56.273956 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.273940 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 13:44:56.273956 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.273946 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 13:44:56.274315 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.274296 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:56.274665 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.274533 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 13:44:56.274665 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.274550 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 13:44:56.274810 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.274674 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 13:44:56.274810 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.274704 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 13:44:56.274810 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.274716 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 13:44:56.275076 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275060 2581 factory.go:55] Registering systemd factory Jul 06 13:44:56.275076 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275075 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 13:44:56.275259 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275247 2581 factory.go:153] Registering CRI-O factory Jul 06 13:44:56.275311 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275264 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 13:44:56.275356 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275326 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 13:44:56.275410 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275355 2581 factory.go:103] Registering Raw factory Jul 06 13:44:56.275410 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275385 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 13:44:56.275727 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.275714 2581 manager.go:349] Starting recovery of all containers Jul 06 13:44:56.281922 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.281889 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 13:44:56.281922 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.281903 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 13:44:56.286459 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.286442 2581 manager.go:354] Recovery completed Jul 06 13:44:56.291931 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.291917 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:56.293835 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.293812 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:56.293901 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.293843 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:56.293901 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.293855 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:56.294433 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.294418 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 13:44:56.294505 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.294444 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 13:44:56.294505 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.294446 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:56.294505 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.294462 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:44:56.295230 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295213 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:56.295312 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295250 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:56.295312 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295265 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:56.295689 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295677 2581 policy_none.go:49] "None policy: Start" Jul 06 13:44:56.295754 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295693 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 13:44:56.295754 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.295703 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 13:44:56.296043 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.295980 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-72.ec2.internal.18bfb747c262e8c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-72.ec2.internal,UID:ip-10-0-143-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-72.ec2.internal,},FirstTimestamp:2026-07-06 13:44:56.293828803 +0000 UTC m=+0.397901353,LastTimestamp:2026-07-06 13:44:56.293828803 +0000 UTC m=+0.397901353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-72.ec2.internal,}" Jul 06 13:44:56.296832 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.296820 2581 policy_none.go:47] "Start" Jul 06 13:44:56.304339 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.304269 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-72.ec2.internal.18bfb747c26337e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-72.ec2.internal,UID:ip-10-0-143-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-72.ec2.internal,},FirstTimestamp:2026-07-06 13:44:56.293849059 +0000 UTC m=+0.397921604,LastTimestamp:2026-07-06 13:44:56.293849059 +0000 UTC m=+0.397921604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-72.ec2.internal,}" Jul 06 13:44:56.315393 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.315233 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-72.ec2.internal.18bfb747c2635f5f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-72.ec2.internal,UID:ip-10-0-143-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-72.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-72.ec2.internal,},FirstTimestamp:2026-07-06 13:44:56.293859167 +0000 UTC m=+0.397931713,LastTimestamp:2026-07-06 13:44:56.293859167 +0000 UTC m=+0.397931713,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-72.ec2.internal,}" Jul 06 13:44:56.319543 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.319526 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpp5c" Jul 06 13:44:56.325521 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.325505 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpp5c" Jul 06 13:44:56.328842 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.328776 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-72.ec2.internal.18bfb747c262e8c3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-72.ec2.internal.18bfb747c262e8c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-72.ec2.internal,UID:ip-10-0-143-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-72.ec2.internal,},FirstTimestamp:2026-07-06 13:44:56.293828803 +0000 UTC m=+0.397901353,LastTimestamp:2026-07-06 13:44:56.295231591 +0000 UTC m=+0.399304135,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-72.ec2.internal,}" Jul 06 13:44:56.334922 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.334910 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 13:44:56.335002 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.334940 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 13:44:56.335002 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.334951 2581 server.go:87] "Starting device plugin registration server" Jul 06 13:44:56.335215 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.335201 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 13:44:56.335274 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.335216 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 13:44:56.335330 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.335301 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 13:44:56.335406 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.335385 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 13:44:56.335406 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:56.335406 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 13:44:56.336064 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.336044 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 13:44:56.336133 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:56.336118 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.505873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.503544 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 13:44:57.505873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.504792 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 13:44:57.505873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.504828 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 13:44:57.505873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.504851 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 13:44:57.505873 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.504888 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 13:44:57.506819 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.506802 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:44:57.570727 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.570695 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:57.571594 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.571578 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:57.571678 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.571607 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:57.571678 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.571618 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:57.571678 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.571644 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.579949 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.579911 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.579949 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.579933 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-72.ec2.internal\": node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.605345 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.605316 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal"] Jul 06 13:44:57.605462 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.605406 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:57.605462 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.605444 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.606816 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.606799 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:57.606885 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.606828 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:57.606885 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.606840 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:57.607984 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.607972 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:57.608126 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.608167 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608158 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:57.608611 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608598 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:57.608611 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608606 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:57.608696 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608624 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:57.608696 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608624 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:57.608696 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608638 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:57.608696 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.608645 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:57.609654 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.609633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.609752 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.609664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.609752 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.609705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27db7d2e29939ec76943127ff4b64abe-config\") pod \"kube-apiserver-proxy-ip-10-0-143-72.ec2.internal\" (UID: \"27db7d2e29939ec76943127ff4b64abe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.609752 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.609733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.609865 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.609770 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:57.610439 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.610421 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:57.610511 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.610446 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:57.610511 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.610459 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:57.630859 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.630843 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-72.ec2.internal\" not found" node="ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.635202 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.635187 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-72.ec2.internal\" not found" node="ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.705653 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.705624 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.709974 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.709945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.710103 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.710001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.710103 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.710030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27db7d2e29939ec76943127ff4b64abe-config\") pod \"kube-apiserver-proxy-ip-10-0-143-72.ec2.internal\" (UID: \"27db7d2e29939ec76943127ff4b64abe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.710103 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.710006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.710103 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.710079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c022c28602618a16a613f30dfbb7344-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal\" (UID: \"0c022c28602618a16a613f30dfbb7344\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.710268 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.710118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27db7d2e29939ec76943127ff4b64abe-config\") pod \"kube-apiserver-proxy-ip-10-0-143-72.ec2.internal\" (UID: \"27db7d2e29939ec76943127ff4b64abe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.806122 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.806078 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.906863 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:57.906778 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:57.934282 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.934223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:57.938452 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:57.938180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:58.007516 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.007482 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.108040 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.108004 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.208509 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.208483 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.308976 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.308952 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.345338 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.345291 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 13:44:58.345772 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.345450 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 13:44:58.409859 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.409829 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.463935 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.463873 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:39:57 +0000 UTC" deadline="2028-01-27 22:12:58.692675424 +0000 UTC" Jul 06 13:44:58.463935 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.463903 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13688h28m0.228775362s" Jul 06 13:44:58.510444 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.510415 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.583492 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.583475 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:44:58.609833 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:44:58.609804 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c022c28602618a16a613f30dfbb7344.slice/crio-e1665e750246b491e1a065989f885ca5dbf3bc1cf466c6830d9835d6e3207703 WatchSource:0}: Error finding container e1665e750246b491e1a065989f885ca5dbf3bc1cf466c6830d9835d6e3207703: Status 404 returned error can't find the container with id e1665e750246b491e1a065989f885ca5dbf3bc1cf466c6830d9835d6e3207703 Jul 06 13:44:58.610485 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:58.610463 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-72.ec2.internal\" not found" Jul 06 13:44:58.627680 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.627661 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:44:58.628717 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.628702 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:44:58.628777 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.628733 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:44:58.628777 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.628746 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:44:58.704442 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.704416 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:44:58.708780 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.708763 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" Jul 06 13:44:58.721007 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.720951 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:44:58.722858 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.722845 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" Jul 06 13:44:58.730765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.730751 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:44:58.787692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.787667 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:44:58.823675 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:58.823647 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:44:59.388139 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.388104 2581 apiserver.go:52] "Watching apiserver" Jul 06 13:44:59.398967 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.398942 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 13:44:59.399571 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.399523 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-dqtmd","openshift-dns/node-resolver-flg4b","openshift-multus/multus-4fb88","openshift-multus/network-metrics-daemon-dhb5t","openshift-network-operator/iptables-alerter-vth87","openshift-ovn-kubernetes/ovnkube-node-kwj9v","kube-system/global-pull-secret-syncer-b55qd","kube-system/konnectivity-agent-wz2mq","kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh","openshift-image-registry/node-ca-6c8rn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-sllhm","openshift-network-diagnostics/network-check-target-54j7l"] Jul 06 13:44:59.401352 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.401294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.401447 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.401397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:44:59.402611 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.402590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.403816 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.403756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.405600 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.405565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.405796 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.405770 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 13:44:59.405873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.405815 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.406086 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.406069 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 13:44:59.406215 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.405774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 13:44:59.406387 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.406349 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 13:44:59.406530 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.406514 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g6t25\"" Jul 06 13:44:59.406596 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.406571 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxfs9\"" Jul 06 13:44:59.406815 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.406797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.406909 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.406858 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:44:59.407148 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.407131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.408484 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.408431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.411763 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.410129 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 13:44:59.411763 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.410397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 13:44:59.411763 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.410494 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7khd\"" Jul 06 13:44:59.411763 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.410718 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.411763 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.410819 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412101 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412321 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4smv\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412532 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 13:44:59.413069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.412832 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.414711 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.414264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:44:59.414711 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.414351 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.415150 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.416160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-netd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-system-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-script-lib\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-os-release\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-bin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-systemd-units\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-log-socket\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cni-binary-copy\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-socket-dir-parent\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9e6b3e-8671-4571-8baf-f96188ad7459-iptables-alerter-script\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9e6b3e-8671-4571-8baf-f96188ad7459-host-slash\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.418423 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-dbus\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-node-log\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-bin\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-os-release\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-netns\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-var-lib-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-multus-certs\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lffh\" (UniqueName: \"kubernetes.io/projected/50d50b74-72bf-4088-87f7-efdcb344cd51-kube-api-access-9lffh\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-etc-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovn-node-metrics-cert\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cnibin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-ovn\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.417982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-env-overrides\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99r9f\" (UniqueName: \"kubernetes.io/projected/93ae3707-d891-49b0-803e-0c9ffbe6a161-kube-api-access-99r9f\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.419277 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk98r\" (UniqueName: \"kubernetes.io/projected/6152ccaa-2121-4a26-b5e0-a32e1013d61e-kube-api-access-wk98r\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-slash\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-system-cni-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-k8s-cni-cncf-io\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-multus\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-etc-kubernetes\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-netns\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q5wk\" (UniqueName: \"kubernetes.io/projected/fa9e6b3e-8671-4571-8baf-f96188ad7459-kube-api-access-9q5wk\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-kubelet-config\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cnibin\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-kubelet\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-hostroot\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-conf-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-systemd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6fk\" (UniqueName: \"kubernetes.io/projected/74d2fc4e-14e6-440c-a2dc-a6b24e648492-kube-api-access-zp6fk\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-kubelet\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.418756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-config\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.419642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.419699 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2rrh\"" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.420447 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.421098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.421462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.421881 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.421720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-daemon-config\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.423017 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.422797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.423802 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.423770 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.424680 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.424396 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.424680 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.424511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.424680 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.424594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 13:44:59.424870 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.424835 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.425039 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.425256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-skx7r\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.425735 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ff7tj\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.425879 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.425938 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.426148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.426299 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 13:44:59.426503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.426364 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h9bt7\"" Jul 06 13:44:59.428202 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.427732 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 13:44:59.428202 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.428012 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xbwb2\"" Jul 06 13:44:59.428202 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.428015 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 13:44:59.447944 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.447912 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxn8v" Jul 06 13:44:59.456582 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.456561 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wxn8v" Jul 06 13:44:59.510094 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.510072 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 13:44:59.510745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.510693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" event={"ID":"0c022c28602618a16a613f30dfbb7344","Type":"ContainerStarted","Data":"e1665e750246b491e1a065989f885ca5dbf3bc1cf466c6830d9835d6e3207703"} Jul 06 13:44:59.511825 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.511805 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:44:59.512276 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.512248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" event={"ID":"27db7d2e29939ec76943127ff4b64abe","Type":"ContainerStarted","Data":"b3a0fc666b4ec6f4fe475983c99f9563f349247deb16f8df0b8c8d5bc24cfbd7"} Jul 06 13:44:59.522638 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cnibin\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.522750 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.522750 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-kubelet\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.522750 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-kubernetes\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.522750 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-host\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.522965 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.522725 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cnibin\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.529557 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-tmp\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.529557 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqntb\" (UniqueName: \"kubernetes.io/projected/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-kube-api-access-cqntb\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.529557 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4480b57a-fc82-49f4-bd1d-ad9427276563-hosts-file\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.529557 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-hostroot\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.529815 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529595 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.529815 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-kubelet\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.529815 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-conf-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.529815 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-systemd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-registration-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.530024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.529937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-hostroot\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-etc-selinux\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.530328 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-conf\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.530328 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.530328 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6fk\" (UniqueName: \"kubernetes.io/projected/74d2fc4e-14e6-440c-a2dc-a6b24e648492-kube-api-access-zp6fk\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.530328 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-kubelet\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530328 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530568 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-conf-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530568 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530568 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-systemd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530568 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-kubelet\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530758 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-config\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530758 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-lib-modules\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.530758 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-host\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.530758 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-serviceca\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.530758 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-daemon-config\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-netd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4480b57a-fc82-49f4-bd1d-ad9427276563-tmp-dir\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fnj\" (UniqueName: \"kubernetes.io/projected/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-kube-api-access-22fnj\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.530990 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.530944 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e00b37a9-c40b-4d87-88b7-b04be656a163-konnectivity-ca\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.531597 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.531597 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-system-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.531700 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-config\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531700 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-script-lib\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531797 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-systemd\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.531797 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-os-release\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.531797 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-bin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-systemd-units\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-system-cni-dir\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-log-socket\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-netd\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-bin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.531938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.532221 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.531971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-run\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.532491 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.532555 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-daemon-config\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.532555 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532535 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-os-release\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.532555 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-var-lib-kubelet\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cni-binary-copy\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-log-socket\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-socket-dir-parent\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovnkube-script-lib\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532681 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-multus-socket-dir-parent\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.532753 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.532696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-systemd-units\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533079 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.532855 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:44:59.533132 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9e6b3e-8671-4571-8baf-f96188ad7459-iptables-alerter-script\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.533184 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9e6b3e-8671-4571-8baf-f96188ad7459-host-slash\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.533252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-dbus\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.533252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cni-binary-copy\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.533252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-socket-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.533303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:00.033273357 +0000 UTC m=+3.002861584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533312 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9e6b3e-8671-4571-8baf-f96188ad7459-host-slash\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e00b37a9-c40b-4d87-88b7-b04be656a163-agent-certs\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-node-log\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9e6b3e-8671-4571-8baf-f96188ad7459-iptables-alerter-script\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.533404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-bin\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-dbus\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-node-log\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-os-release\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-cni-bin\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-os-release\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-netns\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-var-lib-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-sys\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-run-netns\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-multus-certs\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.533692 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lffh\" (UniqueName: \"kubernetes.io/projected/50d50b74-72bf-4088-87f7-efdcb344cd51-kube-api-access-9lffh\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-var-lib-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-etc-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovn-node-metrics-cert\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533763 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-multus-certs\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgsr\" (UniqueName: \"kubernetes.io/projected/4480b57a-fc82-49f4-bd1d-ad9427276563-kube-api-access-vqgsr\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-etc-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cnibin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.533979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-ovn\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-env-overrides\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-cnibin\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99r9f\" (UniqueName: \"kubernetes.io/projected/93ae3707-d891-49b0-803e-0c9ffbe6a161-kube-api-access-99r9f\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk98r\" (UniqueName: \"kubernetes.io/projected/6152ccaa-2121-4a26-b5e0-a32e1013d61e-kube-api-access-wk98r\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-slash\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534135 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-system-cni-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-k8s-cni-cncf-io\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-multus\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534409 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-ovn\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-etc-kubernetes\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.534506 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-netns\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q5wk\" (UniqueName: \"kubernetes.io/projected/fa9e6b3e-8671-4571-8baf-f96188ad7459-kube-api-access-9q5wk\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.534560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:00.034538828 +0000 UTC m=+3.004127065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-kubelet-config\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-device-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfh8b\" (UniqueName: \"kubernetes.io/projected/927b0da4-beea-4735-bb79-e007cf2bdf36-kube-api-access-gfh8b\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-modprobe-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.534978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysconfig\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74d2fc4e-14e6-440c-a2dc-a6b24e648492-system-cni-dir\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-sys-fs\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.534855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-tuned\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93ae3707-d891-49b0-803e-0c9ffbe6a161-env-overrides\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24db6f37-127d-422b-998e-4ccdb84cddf0-kubelet-config\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74d2fc4e-14e6-440c-a2dc-a6b24e648492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-k8s-cni-cncf-io\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-var-lib-cni-multus\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535568 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-etc-kubernetes\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535615 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-run-openvswitch\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6152ccaa-2121-4a26-b5e0-a32e1013d61e-host-run-netns\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.535745 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.535729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ae3707-d891-49b0-803e-0c9ffbe6a161-host-slash\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.540371 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.540345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ae3707-d891-49b0-803e-0c9ffbe6a161-ovn-node-metrics-cert\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.541019 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.540522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6fk\" (UniqueName: \"kubernetes.io/projected/74d2fc4e-14e6-440c-a2dc-a6b24e648492-kube-api-access-zp6fk\") pod \"multus-additional-cni-plugins-sllhm\" (UID: \"74d2fc4e-14e6-440c-a2dc-a6b24e648492\") " pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.541019 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.540614 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:44:59.541019 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.540633 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:44:59.541019 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.540643 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:44:59.541019 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:44:59.540698 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:00.040683789 +0000 UTC m=+3.010272017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:44:59.543537 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.543495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk98r\" (UniqueName: \"kubernetes.io/projected/6152ccaa-2121-4a26-b5e0-a32e1013d61e-kube-api-access-wk98r\") pod \"multus-4fb88\" (UID: \"6152ccaa-2121-4a26-b5e0-a32e1013d61e\") " pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.544290 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.544164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99r9f\" (UniqueName: \"kubernetes.io/projected/93ae3707-d891-49b0-803e-0c9ffbe6a161-kube-api-access-99r9f\") pod \"ovnkube-node-kwj9v\" (UID: \"93ae3707-d891-49b0-803e-0c9ffbe6a161\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.544875 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.544426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q5wk\" (UniqueName: \"kubernetes.io/projected/fa9e6b3e-8671-4571-8baf-f96188ad7459-kube-api-access-9q5wk\") pod \"iptables-alerter-vth87\" (UID: \"fa9e6b3e-8671-4571-8baf-f96188ad7459\") " pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.546609 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.546581 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lffh\" (UniqueName: \"kubernetes.io/projected/50d50b74-72bf-4088-87f7-efdcb344cd51-kube-api-access-9lffh\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:44:59.635348 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-systemd\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-run\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-var-lib-kubelet\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-socket-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e00b37a9-c40b-4d87-88b7-b04be656a163-agent-certs\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.635514 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-sys\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgsr\" (UniqueName: \"kubernetes.io/projected/4480b57a-fc82-49f4-bd1d-ad9427276563-kube-api-access-vqgsr\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-run\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-device-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfh8b\" (UniqueName: \"kubernetes.io/projected/927b0da4-beea-4735-bb79-e007cf2bdf36-kube-api-access-gfh8b\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-modprobe-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysconfig\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-sys-fs\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-tuned\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-kubernetes\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-host\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-tmp\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqntb\" (UniqueName: \"kubernetes.io/projected/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-kube-api-access-cqntb\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.635831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-var-lib-kubelet\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4480b57a-fc82-49f4-bd1d-ad9427276563-hosts-file\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-registration-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-etc-selinux\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-conf\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-socket-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.635987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-lib-modules\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-host\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-serviceca\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4480b57a-fc82-49f4-bd1d-ad9427276563-tmp-dir\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fnj\" (UniqueName: \"kubernetes.io/projected/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-kube-api-access-22fnj\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e00b37a9-c40b-4d87-88b7-b04be656a163-konnectivity-ca\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-conf\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636352 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-systemd\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysconfig\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-lib-modules\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-sysctl-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.636558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636557 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-host\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-sys-fs\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636612 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-sys\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e00b37a9-c40b-4d87-88b7-b04be656a163-konnectivity-ca\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4480b57a-fc82-49f4-bd1d-ad9427276563-tmp-dir\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-serviceca\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-kubernetes\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.636995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-modprobe-d\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.637003 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-device-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.637059 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4480b57a-fc82-49f4-bd1d-ad9427276563-hosts-file\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.637095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-registration-dir\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.637142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/927b0da4-beea-4735-bb79-e007cf2bdf36-etc-selinux\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.637437 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.637215 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-host\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.639422 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.639095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e00b37a9-c40b-4d87-88b7-b04be656a163-agent-certs\") pod \"konnectivity-agent-wz2mq\" (UID: \"e00b37a9-c40b-4d87-88b7-b04be656a163\") " pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:44:59.639793 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.639776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-etc-tuned\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.641616 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.641588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-tmp\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.644198 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.644153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgsr\" (UniqueName: \"kubernetes.io/projected/4480b57a-fc82-49f4-bd1d-ad9427276563-kube-api-access-vqgsr\") pod \"node-resolver-flg4b\" (UID: \"4480b57a-fc82-49f4-bd1d-ad9427276563\") " pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.644842 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.644819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fnj\" (UniqueName: \"kubernetes.io/projected/634fbe62-1314-41b6-ace5-c4d9bd60a4f4-kube-api-access-22fnj\") pod \"node-ca-6c8rn\" (UID: \"634fbe62-1314-41b6-ace5-c4d9bd60a4f4\") " pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.645858 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.645815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfh8b\" (UniqueName: \"kubernetes.io/projected/927b0da4-beea-4735-bb79-e007cf2bdf36-kube-api-access-gfh8b\") pod \"aws-ebs-csi-driver-node-98lnh\" (UID: \"927b0da4-beea-4735-bb79-e007cf2bdf36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.646118 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.646100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqntb\" (UniqueName: \"kubernetes.io/projected/df0114a5-6a4e-4c53-a982-cf65c25e7a0e-kube-api-access-cqntb\") pod \"tuned-dqtmd\" (UID: \"df0114a5-6a4e-4c53-a982-cf65c25e7a0e\") " pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.720184 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.720059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sllhm" Jul 06 13:44:59.729310 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.729285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4fb88" Jul 06 13:44:59.741380 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.741360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vth87" Jul 06 13:44:59.749210 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.749191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:44:59.756030 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.756010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" Jul 06 13:44:59.765670 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.765649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" Jul 06 13:44:59.773680 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.773659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-flg4b" Jul 06 13:44:59.789489 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.789468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6c8rn" Jul 06 13:44:59.796290 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:44:59.796271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:45:00.039113 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:00.039078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:00.039305 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:00.039145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:00.039305 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.039249 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:00.039431 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.039307 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:01.039294071 +0000 UTC m=+4.008882292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:00.039431 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.039249 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:00.039431 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.039418 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:01.039395676 +0000 UTC m=+4.008983898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:00.139868 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:00.139834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:00.140055 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.140011 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:00.140055 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.140037 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:00.140055 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.140049 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:00.140216 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:00.140110 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:01.140088195 +0000 UTC m=+4.109676421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:00.459284 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:00.459237 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:39:59 +0000 UTC" deadline="2027-12-09 01:21:19.898847318 +0000 UTC" Jul 06 13:45:00.459284 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:00.459277 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12491h36m19.439575012s" Jul 06 13:45:00.642129 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.642104 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ae3707_d891_49b0_803e_0c9ffbe6a161.slice/crio-07bcea91fe701325f0aefbd9f324d8f3a9e3e1beddfbc22d48dc57638c22ea7f WatchSource:0}: Error finding container 07bcea91fe701325f0aefbd9f324d8f3a9e3e1beddfbc22d48dc57638c22ea7f: Status 404 returned error can't find the container with id 07bcea91fe701325f0aefbd9f324d8f3a9e3e1beddfbc22d48dc57638c22ea7f Jul 06 13:45:00.643506 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.643485 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927b0da4_beea_4735_bb79_e007cf2bdf36.slice/crio-aa3d73ea303067e3cfd1ce1ca3ad6c06e553f8992d7da3097aa3bf0f86f63b8d WatchSource:0}: Error finding container aa3d73ea303067e3cfd1ce1ca3ad6c06e553f8992d7da3097aa3bf0f86f63b8d: Status 404 returned error can't find the container with id aa3d73ea303067e3cfd1ce1ca3ad6c06e553f8992d7da3097aa3bf0f86f63b8d Jul 06 13:45:00.645356 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.645331 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4480b57a_fc82_49f4_bd1d_ad9427276563.slice/crio-b7eaa3f3ec6ae181c30657b168a4d48773da93fcec829d4c5b5540ea4f966f12 WatchSource:0}: Error finding container b7eaa3f3ec6ae181c30657b168a4d48773da93fcec829d4c5b5540ea4f966f12: Status 404 returned error can't find the container with id b7eaa3f3ec6ae181c30657b168a4d48773da93fcec829d4c5b5540ea4f966f12 Jul 06 13:45:00.648217 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.648194 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0114a5_6a4e_4c53_a982_cf65c25e7a0e.slice/crio-d4c5dace7d33dc1dfdfbd72ec8405aed93f8b921d1a2ba3cb51358adcfcdb819 WatchSource:0}: Error finding container d4c5dace7d33dc1dfdfbd72ec8405aed93f8b921d1a2ba3cb51358adcfcdb819: Status 404 returned error can't find the container with id d4c5dace7d33dc1dfdfbd72ec8405aed93f8b921d1a2ba3cb51358adcfcdb819 Jul 06 13:45:00.649835 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.649764 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d2fc4e_14e6_440c_a2dc_a6b24e648492.slice/crio-ac9908e83929548a86a70016b23590e0c39581c99112943fb869e7ab6f6ef8ae WatchSource:0}: Error finding container ac9908e83929548a86a70016b23590e0c39581c99112943fb869e7ab6f6ef8ae: Status 404 returned error can't find the container with id ac9908e83929548a86a70016b23590e0c39581c99112943fb869e7ab6f6ef8ae Jul 06 13:45:00.651595 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.651573 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6152ccaa_2121_4a26_b5e0_a32e1013d61e.slice/crio-a12981f652746ddccbd618cd4f692b0fe144e4013d00794758c99cbc41b6eaa9 WatchSource:0}: Error finding container a12981f652746ddccbd618cd4f692b0fe144e4013d00794758c99cbc41b6eaa9: Status 404 returned error can't find the container with id a12981f652746ddccbd618cd4f692b0fe144e4013d00794758c99cbc41b6eaa9 Jul 06 13:45:00.653484 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.653406 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00b37a9_c40b_4d87_88b7_b04be656a163.slice/crio-a49d558fe9ebf934d839ff872ce05e6795bb85f89a4db43fe2535e61a16885ab WatchSource:0}: Error finding container a49d558fe9ebf934d839ff872ce05e6795bb85f89a4db43fe2535e61a16885ab: Status 404 returned error can't find the container with id a49d558fe9ebf934d839ff872ce05e6795bb85f89a4db43fe2535e61a16885ab Jul 06 13:45:00.653814 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.653792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9e6b3e_8671_4571_8baf_f96188ad7459.slice/crio-7ea2d2d822ad67a1d5fdf94d4cf3ab5b8cd545bf1ad4ae87b046340c6634643f WatchSource:0}: Error finding container 7ea2d2d822ad67a1d5fdf94d4cf3ab5b8cd545bf1ad4ae87b046340c6634643f: Status 404 returned error can't find the container with id 7ea2d2d822ad67a1d5fdf94d4cf3ab5b8cd545bf1ad4ae87b046340c6634643f Jul 06 13:45:00.654904 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:00.654883 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634fbe62_1314_41b6_ace5_c4d9bd60a4f4.slice/crio-a4cc35463b9836bdc5ccc2077645c70ecfb03bb57bc2965825f4fc52cbfcadc7 WatchSource:0}: Error finding container a4cc35463b9836bdc5ccc2077645c70ecfb03bb57bc2965825f4fc52cbfcadc7: Status 404 returned error can't find the container with id a4cc35463b9836bdc5ccc2077645c70ecfb03bb57bc2965825f4fc52cbfcadc7 Jul 06 13:45:01.045992 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.045710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:01.045992 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.045947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:01.045992 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.045861 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:01.046196 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.046045 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:01.046196 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.046047 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.046027739 +0000 UTC m=+6.015615960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:01.046196 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.046093 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.046081511 +0000 UTC m=+6.015669732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:01.146696 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.146662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:01.146846 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.146812 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:01.146846 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.146829 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:01.146846 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.146838 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:01.147002 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.146901 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.146884166 +0000 UTC m=+6.116472392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:01.459761 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.459580 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:39:59 +0000 UTC" deadline="2028-02-14 13:07:39.325604234 +0000 UTC" Jul 06 13:45:01.459761 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.459640 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14111h22m37.865967386s" Jul 06 13:45:01.507028 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.506348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:01.507028 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.506479 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:01.507028 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.506880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:01.507028 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.506973 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:01.507568 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.507440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:01.507568 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:01.507528 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:01.522787 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.522741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" event={"ID":"df0114a5-6a4e-4c53-a982-cf65c25e7a0e","Type":"ContainerStarted","Data":"d4c5dace7d33dc1dfdfbd72ec8405aed93f8b921d1a2ba3cb51358adcfcdb819"} Jul 06 13:45:01.528202 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.528142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-flg4b" event={"ID":"4480b57a-fc82-49f4-bd1d-ad9427276563","Type":"ContainerStarted","Data":"b7eaa3f3ec6ae181c30657b168a4d48773da93fcec829d4c5b5540ea4f966f12"} Jul 06 13:45:01.532024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.531992 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c022c28602618a16a613f30dfbb7344" containerID="84fb46005c8123fd1c55f7c32167c7c592156238dccaf4abb464a8c3d72c4f95" exitCode=0 Jul 06 13:45:01.532391 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.532162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" event={"ID":"0c022c28602618a16a613f30dfbb7344","Type":"ContainerDied","Data":"84fb46005c8123fd1c55f7c32167c7c592156238dccaf4abb464a8c3d72c4f95"} Jul 06 13:45:01.540254 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.539817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" event={"ID":"27db7d2e29939ec76943127ff4b64abe","Type":"ContainerStarted","Data":"221b2842aa6e74261bba6ed5d20b7bc2369c943074728168aaa62a9f3c035d16"} Jul 06 13:45:01.542519 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.542451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vth87" event={"ID":"fa9e6b3e-8671-4571-8baf-f96188ad7459","Type":"ContainerStarted","Data":"7ea2d2d822ad67a1d5fdf94d4cf3ab5b8cd545bf1ad4ae87b046340c6634643f"} Jul 06 13:45:01.547350 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.547277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4fb88" event={"ID":"6152ccaa-2121-4a26-b5e0-a32e1013d61e","Type":"ContainerStarted","Data":"a12981f652746ddccbd618cd4f692b0fe144e4013d00794758c99cbc41b6eaa9"} Jul 06 13:45:01.556093 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.556033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerStarted","Data":"ac9908e83929548a86a70016b23590e0c39581c99112943fb869e7ab6f6ef8ae"} Jul 06 13:45:01.559861 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.559685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" event={"ID":"927b0da4-beea-4735-bb79-e007cf2bdf36","Type":"ContainerStarted","Data":"aa3d73ea303067e3cfd1ce1ca3ad6c06e553f8992d7da3097aa3bf0f86f63b8d"} Jul 06 13:45:01.562739 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.562645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"07bcea91fe701325f0aefbd9f324d8f3a9e3e1beddfbc22d48dc57638c22ea7f"} Jul 06 13:45:01.570306 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.569324 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-72.ec2.internal" podStartSLOduration=3.569306256 podStartE2EDuration="3.569306256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:01.568894783 +0000 UTC m=+4.538483026" watchObservedRunningTime="2026-07-06 13:45:01.569306256 +0000 UTC m=+4.538894502" Jul 06 13:45:01.570306 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.570241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6c8rn" event={"ID":"634fbe62-1314-41b6-ace5-c4d9bd60a4f4","Type":"ContainerStarted","Data":"a4cc35463b9836bdc5ccc2077645c70ecfb03bb57bc2965825f4fc52cbfcadc7"} Jul 06 13:45:01.577301 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:01.577238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz2mq" event={"ID":"e00b37a9-c40b-4d87-88b7-b04be656a163","Type":"ContainerStarted","Data":"a49d558fe9ebf934d839ff872ce05e6795bb85f89a4db43fe2535e61a16885ab"} Jul 06 13:45:02.596127 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:02.595897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" event={"ID":"0c022c28602618a16a613f30dfbb7344","Type":"ContainerStarted","Data":"f0e1f40fe12f228fe8722d4413375d6afcb51ce8247f971fd1998e124a5b43f5"} Jul 06 13:45:02.617936 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:02.616947 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-72.ec2.internal" podStartSLOduration=4.6169239300000005 podStartE2EDuration="4.61692393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:02.614375948 +0000 UTC m=+5.583964194" watchObservedRunningTime="2026-07-06 13:45:02.61692393 +0000 UTC m=+5.586512175" Jul 06 13:45:03.068045 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.068002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:03.068268 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.068079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:03.068346 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.068279 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:03.068393 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.068355 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:07.068334053 +0000 UTC m=+10.037922276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:03.068798 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.068774 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:03.068871 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.068832 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:07.068817007 +0000 UTC m=+10.038405233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:03.169265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.169206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:03.169449 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.169416 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:03.169449 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.169438 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:03.169548 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.169451 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:03.169599 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.169547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:07.169526451 +0000 UTC m=+10.139114685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:03.505404 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.505369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:03.505596 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.505512 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:03.505931 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.505910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:03.506036 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.506004 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:03.506096 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:03.506072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:03.506166 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:03.506147 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:05.505771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:05.505771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:05.505914 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:05.505986 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:05.505778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:05.506252 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:05.506074 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:07.099265 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.099207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:07.099681 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.099302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:07.099681 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.099457 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:07.099681 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.099520 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.099501535 +0000 UTC m=+18.069089771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:07.100002 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.099925 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:07.100002 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.099981 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.099964405 +0000 UTC m=+18.069552662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:07.199907 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.199850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:07.200082 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.200059 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:07.200125 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.200095 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:07.200125 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.200113 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:07.200246 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.200181 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:15.200159947 +0000 UTC m=+18.169748189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:07.506360 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.506328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:07.506531 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.506427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:07.506531 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.506436 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:07.506651 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:07.506562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:07.506651 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.506607 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:07.506651 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:07.506632 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:09.506319 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:09.506148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:09.506319 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:09.506156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:09.506319 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:09.506320 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:09.506861 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:09.506617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:09.506861 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:09.506722 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:09.506861 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:09.506790 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:11.505198 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.505159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:11.505198 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.505159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:11.505688 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:11.505319 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:11.505688 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.505353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:11.505688 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:11.505466 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:11.505688 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:11.505560 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:11.618987 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.618847 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" event={"ID":"df0114a5-6a4e-4c53-a982-cf65c25e7a0e","Type":"ContainerStarted","Data":"ac92ec9131c4150780336c18aa75372454bae2227dc91d4959b09abc5f6bdfe0"} Jul 06 13:45:11.620751 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.620722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-flg4b" event={"ID":"4480b57a-fc82-49f4-bd1d-ad9427276563","Type":"ContainerStarted","Data":"ec00e5f7847b39a3147acc644d29c11b926d244899a97ef1a099200c53058adb"} Jul 06 13:45:11.622570 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.622352 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="59dde124fc69a54628ec0dca2f51f1932dd7d7127d2ee8e935b50425d25766d5" exitCode=0 Jul 06 13:45:11.622671 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.622484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"59dde124fc69a54628ec0dca2f51f1932dd7d7127d2ee8e935b50425d25766d5"} Jul 06 13:45:11.624912 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.624892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" event={"ID":"927b0da4-beea-4735-bb79-e007cf2bdf36","Type":"ContainerStarted","Data":"112082047e424a3caf2fef4af3743f39ecc7c36502903bacdbbe704ce1867b59"} Jul 06 13:45:11.626421 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.626390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6c8rn" event={"ID":"634fbe62-1314-41b6-ace5-c4d9bd60a4f4","Type":"ContainerStarted","Data":"a9bd380f1da169482e03f482fb3fdd52f02264ea4b6d4a41a82a9a2387bf0a00"} Jul 06 13:45:11.628038 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.628018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz2mq" event={"ID":"e00b37a9-c40b-4d87-88b7-b04be656a163","Type":"ContainerStarted","Data":"4d1d2f541d5a122110e913001cb96f559b0b4ff8d7f35856debb28d0a15fd4e4"} Jul 06 13:45:11.639499 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.639451 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dqtmd" podStartSLOduration=4.32538109 podStartE2EDuration="14.639436734s" totalImagesPullingTime="10.314055644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:11.638631489 +0000 UTC m=+14.608219733" watchObservedRunningTime="2026-07-06 13:45:11.639436734 +0000 UTC m=+14.609024979" Jul 06 13:45:11.680513 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.680468 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-flg4b" podStartSLOduration=4.356129506 podStartE2EDuration="14.680452287s" totalImagesPullingTime="10.324322781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:11.680430474 +0000 UTC m=+14.650018718" watchObservedRunningTime="2026-07-06 13:45:11.680452287 +0000 UTC m=+14.650040530" Jul 06 13:45:11.702318 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.702222 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6c8rn" podStartSLOduration=4.39391233 podStartE2EDuration="14.702207754s" totalImagesPullingTime="10.308295424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:11.702169588 +0000 UTC m=+14.671757830" watchObservedRunningTime="2026-07-06 13:45:11.702207754 +0000 UTC m=+14.671795994" Jul 06 13:45:11.721167 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:11.721125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wz2mq" podStartSLOduration=4.413848746 podStartE2EDuration="14.72110985s" totalImagesPullingTime="10.307261104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:11.721063982 +0000 UTC m=+14.690652224" watchObservedRunningTime="2026-07-06 13:45:11.72110985 +0000 UTC m=+14.690698095" Jul 06 13:45:12.633926 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:12.632848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vth87" event={"ID":"fa9e6b3e-8671-4571-8baf-f96188ad7459","Type":"ContainerStarted","Data":"d069916b04ae24ecc0195e5ae8238e983179f3b5c161b8d1206ef0b08e57c9c6"} Jul 06 13:45:13.179474 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.179447 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 13:45:13.480033 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.479908 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:45:13.179465998Z","UUID":"46eff41a-bd46-4db5-9509-17564942ffa0","Handler":null,"Name":"","Endpoint":""} Jul 06 13:45:13.481833 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.481752 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 13:45:13.481833 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.481796 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 13:45:13.509654 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.509625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:13.509820 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:13.509760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:13.510298 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.509996 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:13.510298 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:13.510110 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:13.510298 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.510176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:13.510298 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:13.510266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:13.637216 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:13.637175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" event={"ID":"927b0da4-beea-4735-bb79-e007cf2bdf36","Type":"ContainerStarted","Data":"be734ff5e5ced00e55c982b7760935acca0e35ed7127168337d43351c9d93a87"} Jul 06 13:45:15.166299 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.166258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:15.167069 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.166336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:15.167069 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.166420 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:15.167069 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.166477 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:15.167069 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.166491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:31.166474175 +0000 UTC m=+34.136062415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:15.167069 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.166530 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:31.166514525 +0000 UTC m=+34.136102748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:15.266674 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.266636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:15.266896 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.266825 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:15.266896 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.266852 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:15.266896 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.266864 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:15.267055 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.266930 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:45:31.266911531 +0000 UTC m=+34.236499778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:15.509449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.509419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:15.509449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.509442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:15.509666 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:15.509419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:15.509666 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.509546 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:15.509666 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.509626 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:15.509831 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:15.509720 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:16.480442 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:16.480400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:45:16.481399 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:16.481371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:45:16.498362 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:16.498310 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vth87" podStartSLOduration=9.189860019 podStartE2EDuration="19.498292151s" totalImagesPullingTime="10.308432132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:12.652369294 +0000 UTC m=+15.621957537" watchObservedRunningTime="2026-07-06 13:45:16.498292151 +0000 UTC m=+19.467880393" Jul 06 13:45:16.643457 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:16.643427 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:45:16.644524 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:16.644501 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wz2mq" Jul 06 13:45:17.508531 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:17.508313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:17.508943 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:17.508313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:17.508943 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:17.508632 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:17.508943 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:17.508690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:17.508943 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:17.508333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:17.508943 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:17.508760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:19.505933 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:19.505857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:19.506496 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:19.505857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:19.506496 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:19.505999 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:19.506496 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:19.505857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:19.506496 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:19.506120 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:19.506496 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:19.506201 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:21.508710 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:21.508678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:21.509290 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:21.508814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:21.509290 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:21.508825 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:21.509290 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:21.509005 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:21.509290 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:21.509041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:21.509290 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:21.509130 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:23.505493 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.505426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:23.505854 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:23.505557 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:23.505974 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.505944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:23.506076 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.505426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:23.506076 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:23.506065 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:23.506184 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:23.506140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:23.659440 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.659191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4fb88" event={"ID":"6152ccaa-2121-4a26-b5e0-a32e1013d61e","Type":"ContainerStarted","Data":"5a4354143182b3a0255ba68fa5fa49daaedb62303b8de21f06f0c054ef795923"} Jul 06 13:45:23.661174 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.661074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerStarted","Data":"f09cb5baadb1bfdbae375e01a676e3e240f201542c5404b2ecab5760bff485fd"} Jul 06 13:45:23.663294 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.663270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"a4fbb4c4d887698d0c4a2800910d12b7894c684c3969ae124046085d61ecf242"} Jul 06 13:45:23.663402 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.663333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"c6b48de6d0bcb9f3ea7661e852709201333ce11dd53c3caa636841add8d9ca4c"} Jul 06 13:45:23.683981 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:23.683918 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4fb88" podStartSLOduration=3.863539979 podStartE2EDuration="26.683898113s" totalImagesPullingTime="22.820358134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:23.68326724 +0000 UTC m=+26.652855487" watchObservedRunningTime="2026-07-06 13:45:23.683898113 +0000 UTC m=+26.653486357" Jul 06 13:45:24.666580 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.666548 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="f09cb5baadb1bfdbae375e01a676e3e240f201542c5404b2ecab5760bff485fd" exitCode=0 Jul 06 13:45:24.667100 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.666619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"f09cb5baadb1bfdbae375e01a676e3e240f201542c5404b2ecab5760bff485fd"} Jul 06 13:45:24.668851 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.668825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" event={"ID":"927b0da4-beea-4735-bb79-e007cf2bdf36","Type":"ContainerStarted","Data":"e92e021d0de85ab1a3c1d9998a29c34ca362ecdc42cd01e8a906c1e6385ef490"} Jul 06 13:45:24.671823 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.671796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"d8908cc5917b89c9066b1595ccf4743c1fead16e9f375c77b0c17a6db8e897a7"} Jul 06 13:45:24.671924 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.671861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"0b800844d9dfc5b0847ebb8a78d0c519c741835be6ebc53652b81fd3f3083d06"} Jul 06 13:45:24.671924 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.671903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"984da72c75ce748ef80f7538f72ac20be38d6d6db843e9ae906bb300d7a5307f"} Jul 06 13:45:24.672037 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.671933 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"c6eb6d714f31d4fbd39c36b96d58a774dc464311aa0de7ae60b758c7ee995f84"} Jul 06 13:45:24.717579 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:24.717531 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-98lnh" podStartSLOduration=5.240782764 podStartE2EDuration="27.71751642s" totalImagesPullingTime="22.476733656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:24.717265402 +0000 UTC m=+27.686853647" watchObservedRunningTime="2026-07-06 13:45:24.71751642 +0000 UTC m=+27.687104662" Jul 06 13:45:25.505370 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:25.505284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:25.505629 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:25.505422 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:25.505629 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:25.505299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:25.505629 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:25.505504 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:25.505629 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:25.505296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:25.505629 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:25.505570 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:26.677406 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:26.677374 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="5279bc59725e5b9c669bfdeb485b4fbd0b1bee8715d08788f26cc37d7f2ed95f" exitCode=0 Jul 06 13:45:26.677981 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:26.677447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"5279bc59725e5b9c669bfdeb485b4fbd0b1bee8715d08788f26cc37d7f2ed95f"} Jul 06 13:45:26.682574 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:26.682548 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"b95163ee2db49d01819aead698bb9b5ee5183f0dcb4fc151e5f235dfd96d5b10"} Jul 06 13:45:27.506257 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:27.506210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:27.506430 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:27.506359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:27.506430 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:27.506370 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:27.506551 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:27.506436 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:27.506551 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:27.506450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:27.506650 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:27.506556 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:28.688390 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.688109 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="b4a738dad4a4afcd766704bf244c15a8f6d9ec04c160cd3b3bb4d3637a3846c4" exitCode=0 Jul 06 13:45:28.688888 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.688185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"b4a738dad4a4afcd766704bf244c15a8f6d9ec04c160cd3b3bb4d3637a3846c4"} Jul 06 13:45:28.692059 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.692038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" event={"ID":"93ae3707-d891-49b0-803e-0c9ffbe6a161","Type":"ContainerStarted","Data":"f583b274fe9328a29d45c285cee9b182ae479675652af09a0357088245bfe281"} Jul 06 13:45:28.692346 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.692327 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:45:28.692453 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.692380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:45:28.707983 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.707961 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:45:28.740950 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:28.740900 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" podStartSLOduration=9.170284725 podStartE2EDuration="31.740887521s" totalImagesPullingTime="22.570602796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:28.739166313 +0000 UTC m=+31.708754552" watchObservedRunningTime="2026-07-06 13:45:28.740887521 +0000 UTC m=+31.710475764" Jul 06 13:45:29.505770 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:29.505735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:29.505770 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:29.505769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:29.505996 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:29.505735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:29.505996 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:29.505863 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:29.506081 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:29.505994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:29.506081 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:29.506070 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:29.695314 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:29.695285 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:45:29.717603 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:29.717364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:45:30.374018 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.373981 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54j7l"] Jul 06 13:45:30.374178 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.374161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:30.374311 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:30.374290 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:30.376818 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.376792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhb5t"] Jul 06 13:45:30.376945 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.376887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:30.376996 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:30.376978 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:30.377629 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.377610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b55qd"] Jul 06 13:45:30.377718 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:30.377705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:30.377805 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:30.377789 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:31.185035 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:31.185005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:31.185558 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:31.185052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:31.185558 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.185183 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:31.185558 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.185198 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:31.185558 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.185275 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:03.185252547 +0000 UTC m=+66.154840770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:45:31.185558 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.185302 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret podName:24db6f37-127d-422b-998e-4ccdb84cddf0 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:03.185291504 +0000 UTC m=+66.154879764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret") pod "global-pull-secret-syncer-b55qd" (UID: "24db6f37-127d-422b-998e-4ccdb84cddf0") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:45:31.285612 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:31.285532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:31.285789 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.285698 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:45:31.285789 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.285722 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:45:31.285789 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.285732 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xld4s for pod openshift-network-diagnostics/network-check-target-54j7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:31.285789 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.285787 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s podName:f487dac2-80ab-42eb-82eb-42283c79694e nodeName:}" failed. No retries permitted until 2026-07-06 13:46:03.28577116 +0000 UTC m=+66.255359382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xld4s" (UniqueName: "kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s") pod "network-check-target-54j7l" (UID: "f487dac2-80ab-42eb-82eb-42283c79694e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:45:31.505397 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:31.505326 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:31.505524 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:31.505460 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:32.505024 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:32.504994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:32.505393 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:32.505036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:32.505393 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:32.505105 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:32.505393 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:32.505222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:33.505469 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:33.505252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:33.505891 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:33.505579 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:34.505409 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:34.505382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:34.505511 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:34.505416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:34.505511 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:34.505501 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b55qd" podUID="24db6f37-127d-422b-998e-4ccdb84cddf0" Jul 06 13:45:34.505897 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:34.505614 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhb5t" podUID="50d50b74-72bf-4088-87f7-efdcb344cd51" Jul 06 13:45:34.708377 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:34.708287 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="f4197bf5f75e5dab5a22ea8e8b103ca1e2f191f6615fc8362f24c991feebd3c0" exitCode=0 Jul 06 13:45:34.708377 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:34.708316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"f4197bf5f75e5dab5a22ea8e8b103ca1e2f191f6615fc8362f24c991feebd3c0"} Jul 06 13:45:35.505311 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:35.505288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:35.505491 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:35.505379 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54j7l" podUID="f487dac2-80ab-42eb-82eb-42283c79694e" Jul 06 13:45:35.716014 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:35.715978 2581 generic.go:356] "Generic (PLEG): container finished" podID="74d2fc4e-14e6-440c-a2dc-a6b24e648492" containerID="90adbc7a34ffc8a7df01f259f2b3fb91f43e73a127dad4dd0999e5f818a31a95" exitCode=0 Jul 06 13:45:35.716539 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:35.716049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerDied","Data":"90adbc7a34ffc8a7df01f259f2b3fb91f43e73a127dad4dd0999e5f818a31a95"} Jul 06 13:45:36.312032 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.312004 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-72.ec2.internal" event="NodeReady" Jul 06 13:45:36.312214 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.312144 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 13:45:36.346756 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.346731 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh"] Jul 06 13:45:36.363049 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.363020 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg"] Jul 06 13:45:36.363179 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.363152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.366016 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.365974 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 13:45:36.366164 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.366117 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 13:45:36.366240 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.366170 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 13:45:36.366240 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.366200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 13:45:36.366390 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.366372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hck95\"" Jul 06 13:45:36.383245 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.377223 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:45:36.383245 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.377288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.383837 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.383812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 13:45:36.384070 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.384054 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 13:45:36.384269 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.384253 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 13:45:36.384449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.384434 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 13:45:36.393217 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.391290 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99"] Jul 06 13:45:36.395357 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.395338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.399856 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.399835 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 13:45:36.400181 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.400135 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 13:45:36.400529 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.400514 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 13:45:36.400802 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.400786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htv6h\"" Jul 06 13:45:36.404144 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.404125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 13:45:36.404884 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.404863 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh"] Jul 06 13:45:36.404984 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.404896 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n55w5"] Jul 06 13:45:36.405033 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.405001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.407594 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.407575 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 13:45:36.427192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.427172 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg"] Jul 06 13:45:36.427301 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.427213 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8zxc8"] Jul 06 13:45:36.427342 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.427307 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.430449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.430430 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 13:45:36.430553 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.430431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 13:45:36.430553 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.430471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w8qbs\"" Jul 06 13:45:36.430553 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.430543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 13:45:36.445586 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.445561 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:45:36.445703 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.445603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n55w5"] Jul 06 13:45:36.445703 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.445615 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.445703 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.445624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99"] Jul 06 13:45:36.445703 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.445644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zxc8"] Jul 06 13:45:36.448589 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.448565 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\"" Jul 06 13:45:36.448729 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.448712 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 13:45:36.448729 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.448722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 13:45:36.505107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.505076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:45:36.505313 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.505251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:45:36.507915 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.507898 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\"" Jul 06 13:45:36.507985 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.507897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:45:36.507985 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.507927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:45:36.519835 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.519815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.519922 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.519844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjms9\" (UniqueName: \"kubernetes.io/projected/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-kube-api-access-rjms9\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.519922 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.519871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.519994 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.519919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.519994 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.519944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520055 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.520055 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v22lb\" (UniqueName: \"kubernetes.io/projected/562900ef-572a-4aea-9f3f-33fd6399731c-kube-api-access-v22lb\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.520055 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8p26\" (UniqueName: \"kubernetes.io/projected/8ad4a29f-6b87-4ff9-b100-862b830b712b-kube-api-access-n8p26\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.520142 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520142 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5nmp\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520142 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-tmp\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.520249 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ad4a29f-6b87-4ff9-b100-862b830b712b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.520249 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.520249 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520249 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.520368 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520368 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.520368 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.520368 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.520344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/562900ef-572a-4aea-9f3f-33fd6399731c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.621266 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x92zz\" (UniqueName: \"kubernetes.io/projected/47248937-8d13-4787-ba1e-8a489d308ace-kube-api-access-x92zz\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.621266 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-tmp\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.621266 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ad4a29f-6b87-4ff9-b100-862b830b712b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.621533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.621533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.621533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.621533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.621533 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-cert\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621655 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-tmp\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/562900ef-572a-4aea-9f3f-33fd6399731c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjms9\" (UniqueName: \"kubernetes.io/projected/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-kube-api-access-rjms9\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.621765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47248937-8d13-4787-ba1e-8a489d308ace-config-volume\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctps\" (UniqueName: \"kubernetes.io/projected/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-kube-api-access-hctps\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22lb\" (UniqueName: \"kubernetes.io/projected/562900ef-572a-4aea-9f3f-33fd6399731c-kube-api-access-v22lb\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8p26\" (UniqueName: \"kubernetes.io/projected/8ad4a29f-6b87-4ff9-b100-862b830b712b-kube-api-access-n8p26\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.621999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.622020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47248937-8d13-4787-ba1e-8a489d308ace-tmp-dir\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.622051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.622107 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.622077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5nmp\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.622648 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:36.622286 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:36.622648 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:36.622302 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:36.622648 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:36.622354 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:37.122337634 +0000 UTC m=+40.091925868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:36.622876 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.622851 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.623084 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.623065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/562900ef-572a-4aea-9f3f-33fd6399731c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.623550 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.623487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.624006 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.623985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.626624 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.626594 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.626736 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.626639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-ca\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.626736 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.626723 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ad4a29f-6b87-4ff9-b100-862b830b712b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.626850 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.626761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.627037 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.627018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/562900ef-572a-4aea-9f3f-33fd6399731c-hub\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.627158 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.627095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.627283 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.627260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.627565 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.627550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.637163 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.637124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjms9\" (UniqueName: \"kubernetes.io/projected/733dbf52-6af4-4b32-a563-3ea77e1fd5e5-kube-api-access-rjms9\") pod \"klusterlet-addon-workmgr-7f656d686-29d99\" (UID: \"733dbf52-6af4-4b32-a563-3ea77e1fd5e5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.637329 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.637302 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v22lb\" (UniqueName: \"kubernetes.io/projected/562900ef-572a-4aea-9f3f-33fd6399731c-kube-api-access-v22lb\") pod \"cluster-proxy-proxy-agent-86c7bc45cc-zdbhg\" (UID: \"562900ef-572a-4aea-9f3f-33fd6399731c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.637392 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.637333 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.637791 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.637775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5nmp\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:36.637925 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.637906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8p26\" (UniqueName: \"kubernetes.io/projected/8ad4a29f-6b87-4ff9-b100-862b830b712b-kube-api-access-n8p26\") pod \"managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh\" (UID: \"8ad4a29f-6b87-4ff9-b100-862b830b712b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.701359 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.701326 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" Jul 06 13:45:36.709500 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.709471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:45:36.721837 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.721810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllhm" event={"ID":"74d2fc4e-14e6-440c-a2dc-a6b24e648492","Type":"ContainerStarted","Data":"651d6b3023e518fb07014fd029abd6c6a149c73220e6265e5b953ceb78f9ba4f"} Jul 06 13:45:36.722438 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47248937-8d13-4787-ba1e-8a489d308ace-config-volume\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.722475 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctps\" (UniqueName: \"kubernetes.io/projected/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-kube-api-access-hctps\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.722520 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.722520 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47248937-8d13-4787-ba1e-8a489d308ace-tmp-dir\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.722601 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x92zz\" (UniqueName: \"kubernetes.io/projected/47248937-8d13-4787-ba1e-8a489d308ace-kube-api-access-x92zz\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.722601 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-cert\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.722860 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:36.722827 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:36.722935 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47248937-8d13-4787-ba1e-8a489d308ace-tmp-dir\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.722935 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:36.722897 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:45:37.222879106 +0000 UTC m=+40.192467346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:45:36.723008 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.722997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47248937-8d13-4787-ba1e-8a489d308ace-config-volume\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.724889 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.724872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-cert\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.729375 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.729358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:36.732053 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.732033 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctps\" (UniqueName: \"kubernetes.io/projected/51b7fd1a-937a-41dc-ad31-5eefc2dcd55c-kube-api-access-hctps\") pod \"ingress-canary-n55w5\" (UID: \"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c\") " pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.732580 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.732563 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x92zz\" (UniqueName: \"kubernetes.io/projected/47248937-8d13-4787-ba1e-8a489d308ace-kube-api-access-x92zz\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:36.736413 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.736398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n55w5" Jul 06 13:45:36.749489 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.749443 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sllhm" podStartSLOduration=9.342798146 podStartE2EDuration="39.749423786s" totalImagesPullingTime="30.40662564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:36.747962726 +0000 UTC m=+39.717550982" watchObservedRunningTime="2026-07-06 13:45:36.749423786 +0000 UTC m=+39.719012030" Jul 06 13:45:36.944090 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.943901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg"] Jul 06 13:45:36.947210 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:36.947184 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562900ef_572a_4aea_9f3f_33fd6399731c.slice/crio-25c7b722204f376b222ce2179f2c4671097684a9ea3922ab9560d6719d176bdc WatchSource:0}: Error finding container 25c7b722204f376b222ce2179f2c4671097684a9ea3922ab9560d6719d176bdc: Status 404 returned error can't find the container with id 25c7b722204f376b222ce2179f2c4671097684a9ea3922ab9560d6719d176bdc Jul 06 13:45:36.951663 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.951644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh"] Jul 06 13:45:36.954541 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:36.954521 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ad4a29f_6b87_4ff9_b100_862b830b712b.slice/crio-702549d1339e3898b9e134dcfa374c6106ffebf30d74b65c3b75a78122c9104f WatchSource:0}: Error finding container 702549d1339e3898b9e134dcfa374c6106ffebf30d74b65c3b75a78122c9104f: Status 404 returned error can't find the container with id 702549d1339e3898b9e134dcfa374c6106ffebf30d74b65c3b75a78122c9104f Jul 06 13:45:36.961959 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.961940 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n55w5"] Jul 06 13:45:36.964905 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:36.964879 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b7fd1a_937a_41dc_ad31_5eefc2dcd55c.slice/crio-bb1e86a39818d8bce7b1f461195ed1ad58d836c05bfaf40a5f6df6d17606cac3 WatchSource:0}: Error finding container bb1e86a39818d8bce7b1f461195ed1ad58d836c05bfaf40a5f6df6d17606cac3: Status 404 returned error can't find the container with id bb1e86a39818d8bce7b1f461195ed1ad58d836c05bfaf40a5f6df6d17606cac3 Jul 06 13:45:36.970873 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:36.970849 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99"] Jul 06 13:45:36.972845 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:45:36.972825 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733dbf52_6af4_4b32_a563_3ea77e1fd5e5.slice/crio-765eb346146618425e9a4007bf4d1bc457312a8b9578f7c4d5296d2be7892bbd WatchSource:0}: Error finding container 765eb346146618425e9a4007bf4d1bc457312a8b9578f7c4d5296d2be7892bbd: Status 404 returned error can't find the container with id 765eb346146618425e9a4007bf4d1bc457312a8b9578f7c4d5296d2be7892bbd Jul 06 13:45:37.126724 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.126646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:37.126852 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:37.126766 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:37.126852 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:37.126778 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:37.126852 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:37.126827 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:38.126812777 +0000 UTC m=+41.096400998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:37.227756 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.227721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:37.227928 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:37.227888 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:37.227987 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:37.227973 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:45:38.227949212 +0000 UTC m=+41.197537440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:45:37.506401 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.506370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:45:37.509598 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.509576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:45:37.509897 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.509873 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:45:37.509897 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.509891 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\"" Jul 06 13:45:37.725393 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.725353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n55w5" event={"ID":"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c","Type":"ContainerStarted","Data":"bb1e86a39818d8bce7b1f461195ed1ad58d836c05bfaf40a5f6df6d17606cac3"} Jul 06 13:45:37.726585 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.726558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerStarted","Data":"25c7b722204f376b222ce2179f2c4671097684a9ea3922ab9560d6719d176bdc"} Jul 06 13:45:37.727895 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.727866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" event={"ID":"8ad4a29f-6b87-4ff9-b100-862b830b712b","Type":"ContainerStarted","Data":"702549d1339e3898b9e134dcfa374c6106ffebf30d74b65c3b75a78122c9104f"} Jul 06 13:45:37.729017 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:37.728993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" event={"ID":"733dbf52-6af4-4b32-a563-3ea77e1fd5e5","Type":"ContainerStarted","Data":"765eb346146618425e9a4007bf4d1bc457312a8b9578f7c4d5296d2be7892bbd"} Jul 06 13:45:38.136778 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:38.136727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:38.136972 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:38.136899 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:38.136972 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:38.136917 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:38.137101 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:38.136978 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:40.136957509 +0000 UTC m=+43.106545732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:38.238298 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:38.237547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:38.238298 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:38.237750 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:38.238298 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:38.237815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:45:40.237795738 +0000 UTC m=+43.207383962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:45:40.151350 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:40.151311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:40.151801 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:40.151488 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:40.151801 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:40.151513 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:40.151801 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:40.151587 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:44.151566681 +0000 UTC m=+47.121154904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:40.252217 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:40.252171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:40.252411 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:40.252394 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:40.252499 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:40.252485 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:45:44.252464146 +0000 UTC m=+47.222052371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:45:43.748008 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.747810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n55w5" event={"ID":"51b7fd1a-937a-41dc-ad31-5eefc2dcd55c","Type":"ContainerStarted","Data":"43e2bd5023b20813630c89583f4ed51969f2075b6027876dde9544d444dc1e50"} Jul 06 13:45:43.750211 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.750183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerStarted","Data":"5da776d1266f5939d58a00336838288b6ab24a4cd8d7dfc5981bfabb44945c94"} Jul 06 13:45:43.750360 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.750223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerStarted","Data":"fd73554a15a216eccd819422a7ff1d5e0aaa6029c090511c3a21a8c8c3600a8e"} Jul 06 13:45:43.750360 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.750258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerStarted","Data":"eb8b4325b16b514c415fbd651819d84b16867a9f733d50d863ea9fce17343f21"} Jul 06 13:45:43.751856 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.751810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" event={"ID":"8ad4a29f-6b87-4ff9-b100-862b830b712b","Type":"ContainerStarted","Data":"e4a95dfcf2f5c431ff8a5ebcf7312ad3d7ecfcbc2b310673173087683fda56d8"} Jul 06 13:45:43.768376 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.768336 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n55w5" podStartSLOduration=1.8294230009999999 podStartE2EDuration="7.768321748s" totalImagesPullingTime="5.938898747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:43.767652162 +0000 UTC m=+46.737240405" watchObservedRunningTime="2026-07-06 13:45:43.768321748 +0000 UTC m=+46.737909982" Jul 06 13:45:43.790927 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.790871 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf7ccb66-mgbdh" podStartSLOduration=33.842528656 podStartE2EDuration="39.790852662s" totalImagesPullingTime="5.948324006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:43.789805337 +0000 UTC m=+46.759393579" watchObservedRunningTime="2026-07-06 13:45:43.790852662 +0000 UTC m=+46.760440907" Jul 06 13:45:43.811307 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:43.811266 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" podStartSLOduration=33.836719526 podStartE2EDuration="39.811251079s" totalImagesPullingTime="5.974531553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:43.810114598 +0000 UTC m=+46.779702842" watchObservedRunningTime="2026-07-06 13:45:43.811251079 +0000 UTC m=+46.780839299" Jul 06 13:45:44.185542 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:44.185508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:44.185714 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:44.185641 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:44.185714 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:44.185662 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:44.185792 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:44.185718 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:52.185703564 +0000 UTC m=+55.155291784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:44.286525 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:44.286489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:44.286665 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:44.286610 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:44.286665 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:44.286661 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:45:52.286648393 +0000 UTC m=+55.256236615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:45:47.764365 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:47.764327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" event={"ID":"733dbf52-6af4-4b32-a563-3ea77e1fd5e5","Type":"ContainerStarted","Data":"4bf2fa4030ec9026914681521c035dbebe17aa940d159ce12d2e8a252e6f53f3"} Jul 06 13:45:47.764890 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:47.764537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:47.766174 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:47.766154 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" Jul 06 13:45:47.782067 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:47.782020 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f656d686-29d99" podStartSLOduration=33.729397497 podStartE2EDuration="43.782004176s" totalImagesPullingTime="10.052606679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:47.781366764 +0000 UTC m=+50.750955031" watchObservedRunningTime="2026-07-06 13:45:47.782004176 +0000 UTC m=+50.751592419" Jul 06 13:45:52.246549 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:52.246505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:45:52.247126 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:52.246641 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:45:52.247126 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:52.246660 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:45:52.247126 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:52.246746 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:08.246724622 +0000 UTC m=+71.216312860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:45:52.347756 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:45:52.347699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:45:52.347930 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:52.347842 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:45:52.347930 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:45:52.347917 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:46:08.347900568 +0000 UTC m=+71.317488792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:46:01.709789 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:01.709760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwj9v" Jul 06 13:46:03.223848 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.223808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:46:03.224263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.223871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:46:03.226667 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.226647 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:46:03.226712 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.226673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:46:03.234289 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:03.234271 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 13:46:03.234343 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:03.234333 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs podName:50d50b74-72bf-4088-87f7-efdcb344cd51 nodeName:}" failed. No retries permitted until 2026-07-06 13:47:07.234316923 +0000 UTC m=+130.203905144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs") pod "network-metrics-daemon-dhb5t" (UID: "50d50b74-72bf-4088-87f7-efdcb344cd51") : secret "metrics-daemon-secret" not found Jul 06 13:46:03.237926 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.237900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24db6f37-127d-422b-998e-4ccdb84cddf0-original-pull-secret\") pod \"global-pull-secret-syncer-b55qd\" (UID: \"24db6f37-127d-422b-998e-4ccdb84cddf0\") " pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:46:03.325104 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.325064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:46:03.328185 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.328169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:46:03.337968 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.337946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:46:03.348516 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.348484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xld4s\" (UniqueName: \"kubernetes.io/projected/f487dac2-80ab-42eb-82eb-42283c79694e-kube-api-access-xld4s\") pod \"network-check-target-54j7l\" (UID: \"f487dac2-80ab-42eb-82eb-42283c79694e\") " pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:46:03.514674 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.514589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b55qd" Jul 06 13:46:03.620170 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.620142 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\"" Jul 06 13:46:03.626409 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.626383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:46:03.640096 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.640070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b55qd"] Jul 06 13:46:03.642882 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:03.642860 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24db6f37_127d_422b_998e_4ccdb84cddf0.slice/crio-202c19badb3497b8d988562389c01cf6f1b8cc1703e8b3b1aebf6edf790326b2 WatchSource:0}: Error finding container 202c19badb3497b8d988562389c01cf6f1b8cc1703e8b3b1aebf6edf790326b2: Status 404 returned error can't find the container with id 202c19badb3497b8d988562389c01cf6f1b8cc1703e8b3b1aebf6edf790326b2 Jul 06 13:46:03.746975 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.746946 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54j7l"] Jul 06 13:46:03.749822 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:03.749795 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf487dac2_80ab_42eb_82eb_42283c79694e.slice/crio-b97903d1d1670a09ff8ee5c4616c39155ffb4e15dd019a36609f894325baebc4 WatchSource:0}: Error finding container b97903d1d1670a09ff8ee5c4616c39155ffb4e15dd019a36609f894325baebc4: Status 404 returned error can't find the container with id b97903d1d1670a09ff8ee5c4616c39155ffb4e15dd019a36609f894325baebc4 Jul 06 13:46:03.812825 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.812733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b55qd" event={"ID":"24db6f37-127d-422b-998e-4ccdb84cddf0","Type":"ContainerStarted","Data":"202c19badb3497b8d988562389c01cf6f1b8cc1703e8b3b1aebf6edf790326b2"} Jul 06 13:46:03.813795 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:03.813770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54j7l" event={"ID":"f487dac2-80ab-42eb-82eb-42283c79694e","Type":"ContainerStarted","Data":"b97903d1d1670a09ff8ee5c4616c39155ffb4e15dd019a36609f894325baebc4"} Jul 06 13:46:08.268276 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.268221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:46:08.268870 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:08.268386 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:46:08.268870 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:08.268405 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fbfcd855c-jnqhz: secret "image-registry-tls" not found Jul 06 13:46:08.268870 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:08.268468 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls podName:7137c802-5268-4d0d-a71a-1b52dd5b68b1 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:40.268447312 +0000 UTC m=+103.238035536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls") pod "image-registry-5fbfcd855c-jnqhz" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1") : secret "image-registry-tls" not found Jul 06 13:46:08.368962 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.368916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:08.369149 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:08.369031 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:46:08.369149 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:08.369083 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls podName:47248937-8d13-4787-ba1e-8a489d308ace nodeName:}" failed. No retries permitted until 2026-07-06 13:46:40.369070473 +0000 UTC m=+103.338658694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls") pod "dns-default-8zxc8" (UID: "47248937-8d13-4787-ba1e-8a489d308ace") : secret "dns-default-metrics-tls" not found Jul 06 13:46:08.835197 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.835156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54j7l" event={"ID":"f487dac2-80ab-42eb-82eb-42283c79694e","Type":"ContainerStarted","Data":"e1ee4b77bdb63e82f79b5dc0517f5850bf3ab3b41c94d586f573114697143f4b"} Jul 06 13:46:08.835399 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.835278 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:46:08.836542 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.836518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b55qd" event={"ID":"24db6f37-127d-422b-998e-4ccdb84cddf0","Type":"ContainerStarted","Data":"8df31be89bb78e8b9a7241cc12e44dab170a0fd26b5245030835d1c3a6591b4e"} Jul 06 13:46:08.853516 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:08.853475 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-54j7l" podStartSLOduration=67.231002161 podStartE2EDuration="1m11.853462926s" totalImagesPullingTime="4.622460765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:08.851859036 +0000 UTC m=+71.821447279" watchObservedRunningTime="2026-07-06 13:46:08.853462926 +0000 UTC m=+71.823051169" Jul 06 13:46:09.596086 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.596031 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b55qd" podStartSLOduration=67.862936967 podStartE2EDuration="1m12.596011819s" totalImagesPullingTime="4.733074852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:08.867577822 +0000 UTC m=+71.837166066" watchObservedRunningTime="2026-07-06 13:46:09.596011819 +0000 UTC m=+72.565600056" Jul 06 13:46:09.596972 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.596955 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dzj7k"] Jul 06 13:46:09.599001 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.598987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.607673 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.607654 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 13:46:09.607900 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.607884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 13:46:09.608003 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.607966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 13:46:09.608587 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.608570 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqx8g\"" Jul 06 13:46:09.608671 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.608613 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 13:46:09.621420 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.621398 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzj7k"] Jul 06 13:46:09.679181 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.679154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e44850ce-82e8-47ad-be3a-95c1b2c49e47-crio-socket\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.679181 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.679180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.679411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.679222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnpm2\" (UniqueName: \"kubernetes.io/projected/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-api-access-bnpm2\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.679411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.679325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.679411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.679394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e44850ce-82e8-47ad-be3a-95c1b2c49e47-data-volume\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.779913 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.779874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e44850ce-82e8-47ad-be3a-95c1b2c49e47-crio-socket\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.779913 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.779913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.780179 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.780027 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e44850ce-82e8-47ad-be3a-95c1b2c49e47-crio-socket\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.780179 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.780045 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnpm2\" (UniqueName: \"kubernetes.io/projected/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-api-access-bnpm2\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.780179 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.780098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.780179 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:09.780127 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:09.780179 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.780138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e44850ce-82e8-47ad-be3a-95c1b2c49e47-data-volume\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.780443 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:09.780195 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.280176711 +0000 UTC m=+73.249764932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : configmap "kube-rbac-proxy" not found Jul 06 13:46:09.780443 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:09.780268 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:09.780443 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:09.780326 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.280309438 +0000 UTC m=+73.249897659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:09.780596 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.780518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e44850ce-82e8-47ad-be3a-95c1b2c49e47-data-volume\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:09.792643 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:09.792610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnpm2\" (UniqueName: \"kubernetes.io/projected/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-api-access-bnpm2\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:10.284078 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:10.284036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:10.284312 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:10.284102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:10.284312 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:10.284189 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:10.284312 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:10.284196 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:10.284312 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:10.284287 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.284269708 +0000 UTC m=+74.253857930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : configmap "kube-rbac-proxy" not found Jul 06 13:46:10.284312 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:10.284302 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.284295035 +0000 UTC m=+74.253883256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:11.292942 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:11.292900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:11.293346 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:11.292972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:11.293346 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:11.293051 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:11.293346 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:11.293079 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:11.293346 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:11.293104 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.293091644 +0000 UTC m=+76.262679865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : configmap "kube-rbac-proxy" not found Jul 06 13:46:11.293346 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:11.293136 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.293121527 +0000 UTC m=+76.262709748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:11.601038 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:11.600962 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-flg4b_4480b57a-fc82-49f4-bd1d-ad9427276563/dns-node-resolver/0.log" Jul 06 13:46:12.399772 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:12.399743 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6c8rn_634fbe62-1314-41b6-ace5-c4d9bd60a4f4/node-ca/0.log" Jul 06 13:46:13.311564 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:13.311526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:13.311760 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:13.311599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:13.311760 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:13.311660 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:13.311760 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:13.311695 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:13.311760 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:13.311728 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.311712807 +0000 UTC m=+80.281301028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : configmap "kube-rbac-proxy" not found Jul 06 13:46:13.311760 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:13.311742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.311736286 +0000 UTC m=+80.281324507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:13.599923 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:13.599843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n55w5_51b7fd1a-937a-41dc-ad31-5eefc2dcd55c/serve-healthcheck-canary/0.log" Jul 06 13:46:17.338333 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:17.338286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:17.338858 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:17.338390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:17.338858 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:17.338411 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:46:17.338858 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:17.338482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.338465247 +0000 UTC m=+88.308053469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : configmap "kube-rbac-proxy" not found Jul 06 13:46:17.338858 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:17.338522 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:17.338858 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:17.338579 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.338563061 +0000 UTC m=+88.308151285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:25.395022 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:25.394881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:25.395022 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:25.394975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:25.395486 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:25.395044 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:46:25.395486 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:46:25.395121 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls podName:e44850ce-82e8-47ad-be3a-95c1b2c49e47 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:41.39510621 +0000 UTC m=+104.364694431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzj7k" (UID: "e44850ce-82e8-47ad-be3a-95c1b2c49e47") : secret "insights-runtime-extractor-tls" not found Jul 06 13:46:25.395592 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:25.395570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e44850ce-82e8-47ad-be3a-95c1b2c49e47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:39.842501 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:39.842471 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-54j7l" Jul 06 13:46:40.303387 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.303348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:46:40.305673 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.305646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"image-registry-5fbfcd855c-jnqhz\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:46:40.327269 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.327243 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htv6h\"" Jul 06 13:46:40.334759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.334738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:46:40.403958 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.403923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:40.406283 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.406262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47248937-8d13-4787-ba1e-8a489d308ace-metrics-tls\") pod \"dns-default-8zxc8\" (UID: \"47248937-8d13-4787-ba1e-8a489d308ace\") " pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:40.494590 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.494554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:46:40.498044 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:40.498004 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7137c802_5268_4d0d_a71a_1b52dd5b68b1.slice/crio-efdee26445a2c21101edd92e09454904d10c61f343d7b0d2eec9e8c49dd5b7e1 WatchSource:0}: Error finding container efdee26445a2c21101edd92e09454904d10c61f343d7b0d2eec9e8c49dd5b7e1: Status 404 returned error can't find the container with id efdee26445a2c21101edd92e09454904d10c61f343d7b0d2eec9e8c49dd5b7e1 Jul 06 13:46:40.656246 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.656206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\"" Jul 06 13:46:40.664469 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.664446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:40.807660 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.807573 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zxc8"] Jul 06 13:46:40.810916 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:40.810883 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47248937_8d13_4787_ba1e_8a489d308ace.slice/crio-217fee756d9d0bfc7e7768dcbd26b2b1333ff28b593a4b26e8c9fd1e7cfae6d1 WatchSource:0}: Error finding container 217fee756d9d0bfc7e7768dcbd26b2b1333ff28b593a4b26e8c9fd1e7cfae6d1: Status 404 returned error can't find the container with id 217fee756d9d0bfc7e7768dcbd26b2b1333ff28b593a4b26e8c9fd1e7cfae6d1 Jul 06 13:46:40.931154 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.931113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zxc8" event={"ID":"47248937-8d13-4787-ba1e-8a489d308ace","Type":"ContainerStarted","Data":"217fee756d9d0bfc7e7768dcbd26b2b1333ff28b593a4b26e8c9fd1e7cfae6d1"} Jul 06 13:46:40.932660 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.932637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" event={"ID":"7137c802-5268-4d0d-a71a-1b52dd5b68b1","Type":"ContainerStarted","Data":"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555"} Jul 06 13:46:40.932756 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.932680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" event={"ID":"7137c802-5268-4d0d-a71a-1b52dd5b68b1","Type":"ContainerStarted","Data":"efdee26445a2c21101edd92e09454904d10c61f343d7b0d2eec9e8c49dd5b7e1"} Jul 06 13:46:40.932793 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.932778 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:46:40.951822 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:40.951768 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" podStartSLOduration=102.951744763 podStartE2EDuration="1m42.951744763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:40.951724111 +0000 UTC m=+103.921312353" watchObservedRunningTime="2026-07-06 13:46:40.951744763 +0000 UTC m=+103.921333010" Jul 06 13:46:41.413055 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:41.413018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:41.415984 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:41.415953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e44850ce-82e8-47ad-be3a-95c1b2c49e47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzj7k\" (UID: \"e44850ce-82e8-47ad-be3a-95c1b2c49e47\") " pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:41.707448 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:41.707410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzj7k" Jul 06 13:46:41.845086 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:41.845051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzj7k"] Jul 06 13:46:41.848527 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:41.848492 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44850ce_82e8_47ad_be3a_95c1b2c49e47.slice/crio-f4fc8ee01e0e0af9da8fb2de1b44291321bc22b5a27b36af0c5b78dca92e32e7 WatchSource:0}: Error finding container f4fc8ee01e0e0af9da8fb2de1b44291321bc22b5a27b36af0c5b78dca92e32e7: Status 404 returned error can't find the container with id f4fc8ee01e0e0af9da8fb2de1b44291321bc22b5a27b36af0c5b78dca92e32e7 Jul 06 13:46:41.937169 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:41.937129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzj7k" event={"ID":"e44850ce-82e8-47ad-be3a-95c1b2c49e47","Type":"ContainerStarted","Data":"f4fc8ee01e0e0af9da8fb2de1b44291321bc22b5a27b36af0c5b78dca92e32e7"} Jul 06 13:46:42.944519 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:42.944475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zxc8" event={"ID":"47248937-8d13-4787-ba1e-8a489d308ace","Type":"ContainerStarted","Data":"334b48b352db38e47e97943d8f325796ebeaf42f1faf56b51a9d0ea86c6716d2"} Jul 06 13:46:42.945090 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:42.944572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zxc8" event={"ID":"47248937-8d13-4787-ba1e-8a489d308ace","Type":"ContainerStarted","Data":"a9c626f9407442a28e0670d57004c6c95187add3f865a4843b15089cb579f765"} Jul 06 13:46:42.945090 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:42.944786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:42.968263 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:42.968193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8zxc8" podStartSLOduration=65.319323488 podStartE2EDuration="1m6.968171546s" totalImagesPullingTime="1.648848058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:42.967684155 +0000 UTC m=+105.937272399" watchObservedRunningTime="2026-07-06 13:46:42.968171546 +0000 UTC m=+105.937759793" Jul 06 13:46:45.957001 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:45.956966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzj7k" event={"ID":"e44850ce-82e8-47ad-be3a-95c1b2c49e47","Type":"ContainerStarted","Data":"a9363c8ddcd10831b9f6ef25be31edde522f3ee5840b713d9302dfea7001fa10"} Jul 06 13:46:46.961476 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:46.961442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzj7k" event={"ID":"e44850ce-82e8-47ad-be3a-95c1b2c49e47","Type":"ContainerStarted","Data":"740db04d977b366aa573f781338097c291c3dbce2596a44d860f9a7b946c3cb5"} Jul 06 13:46:49.973163 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:49.973129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzj7k" event={"ID":"e44850ce-82e8-47ad-be3a-95c1b2c49e47","Type":"ContainerStarted","Data":"6012c0c5122bd281bda56662d1d9ce848f688d7c3ed7d0f5470eae478fa7205e"} Jul 06 13:46:49.992438 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:49.992396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dzj7k" podStartSLOduration=33.945260846 podStartE2EDuration="40.992381748s" totalImagesPullingTime="7.047120902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:49.991800456 +0000 UTC m=+112.961388699" watchObservedRunningTime="2026-07-06 13:46:49.992381748 +0000 UTC m=+112.961970037" Jul 06 13:46:52.950943 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:52.950912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8zxc8" Jul 06 13:46:54.656385 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.656349 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mpwcl"] Jul 06 13:46:54.659640 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.659624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.662574 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.662548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqf4q\"" Jul 06 13:46:54.662912 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.662894 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 13:46:54.663876 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.663846 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 13:46:54.663876 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.663855 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 13:46:54.663876 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.663869 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 13:46:54.664078 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.663859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 13:46:54.664078 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.663959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 13:46:54.716759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-tls\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716759 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-metrics-client-ca\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2qxm\" (UniqueName: \"kubernetes.io/projected/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-kube-api-access-p2qxm\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-root\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-wtmp\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.716953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-sys\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.717106 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.716983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-textfile\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.717106 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.717009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818214 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818385 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-tls\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818385 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-metrics-client-ca\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818385 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818385 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2qxm\" (UniqueName: \"kubernetes.io/projected/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-kube-api-access-p2qxm\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818578 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-root\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818578 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-wtmp\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818578 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-sys\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818578 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-textfile\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818578 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818501 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-root\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818814 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818653 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-wtmp\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818814 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818703 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-sys\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818814 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818792 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-textfile\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818918 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.818983 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.818965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-metrics-client-ca\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.820672 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.820644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.820762 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.820691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-node-exporter-tls\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.832559 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.832539 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2qxm\" (UniqueName: \"kubernetes.io/projected/c583762f-9cf8-4c32-93a2-1c4f82f4fdf4-kube-api-access-p2qxm\") pod \"node-exporter-mpwcl\" (UID: \"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4\") " pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.968747 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.968708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpwcl" Jul 06 13:46:54.979187 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:46:54.979152 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc583762f_9cf8_4c32_93a2_1c4f82f4fdf4.slice/crio-d9acc1402ab93ad46a847908629a5c0b9086136d7303071526b128f006862a39 WatchSource:0}: Error finding container d9acc1402ab93ad46a847908629a5c0b9086136d7303071526b128f006862a39: Status 404 returned error can't find the container with id d9acc1402ab93ad46a847908629a5c0b9086136d7303071526b128f006862a39 Jul 06 13:46:54.990379 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:54.990347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpwcl" event={"ID":"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4","Type":"ContainerStarted","Data":"d9acc1402ab93ad46a847908629a5c0b9086136d7303071526b128f006862a39"} Jul 06 13:46:56.998764 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:56.998732 2581 generic.go:356] "Generic (PLEG): container finished" podID="c583762f-9cf8-4c32-93a2-1c4f82f4fdf4" containerID="c2958eb56a9ec71a311142fc25f629b655d3314cb3db808c6984ecbcef6a48d0" exitCode=0 Jul 06 13:46:56.999177 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:56.998787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpwcl" event={"ID":"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4","Type":"ContainerDied","Data":"c2958eb56a9ec71a311142fc25f629b655d3314cb3db808c6984ecbcef6a48d0"} Jul 06 13:46:58.004062 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:58.004018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpwcl" event={"ID":"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4","Type":"ContainerStarted","Data":"428b3f1ff3e50ee740a4eeb89d310f0e13dedb1d8d88e1f03d7ec55d30a87ba3"} Jul 06 13:46:58.004478 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:58.004088 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpwcl" event={"ID":"c583762f-9cf8-4c32-93a2-1c4f82f4fdf4","Type":"ContainerStarted","Data":"fdd25fe5fa2a70e374fbb0ab62f1f4ccdba72783b2fa0bac275142adac8d1c0e"} Jul 06 13:46:58.026013 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:46:58.025967 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mpwcl" podStartSLOduration=2.77191863 podStartE2EDuration="4.025952514s" totalImagesPullingTime="1.189276805s" totalInitContainerRuntime="64.757079ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:58.024297703 +0000 UTC m=+120.993885946" watchObservedRunningTime="2026-07-06 13:46:58.025952514 +0000 UTC m=+120.995540753" Jul 06 13:47:00.339294 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:00.339255 2581 patch_prober.go:28] interesting pod/image-registry-5fbfcd855c-jnqhz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 13:47:00.339662 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:00.339310 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 13:47:01.942365 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:01.942335 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:47:06.710808 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:06.710765 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" podUID="562900ef-572a-4aea-9f3f-33fd6399731c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 13:47:07.261257 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.261213 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:47:07.314607 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.314572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:47:07.316976 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.316955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50d50b74-72bf-4088-87f7-efdcb344cd51-metrics-certs\") pod \"network-metrics-daemon-dhb5t\" (UID: \"50d50b74-72bf-4088-87f7-efdcb344cd51\") " pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:47:07.422878 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.422845 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\"" Jul 06 13:47:07.430567 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.430539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhb5t" Jul 06 13:47:07.563817 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:07.563788 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhb5t"] Jul 06 13:47:07.566786 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:47:07.566760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d50b74_72bf_4088_87f7_efdcb344cd51.slice/crio-99fe95518292a7c337227d5257d438836230fce6ae3329011981810598e59b5f WatchSource:0}: Error finding container 99fe95518292a7c337227d5257d438836230fce6ae3329011981810598e59b5f: Status 404 returned error can't find the container with id 99fe95518292a7c337227d5257d438836230fce6ae3329011981810598e59b5f Jul 06 13:47:08.038528 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:08.038492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhb5t" event={"ID":"50d50b74-72bf-4088-87f7-efdcb344cd51","Type":"ContainerStarted","Data":"99fe95518292a7c337227d5257d438836230fce6ae3329011981810598e59b5f"} Jul 06 13:47:09.043544 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:09.043450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhb5t" event={"ID":"50d50b74-72bf-4088-87f7-efdcb344cd51","Type":"ContainerStarted","Data":"c9969cdbdd1bfb8e7095c60f93720824d58d70eaf4899cf449256b77da63e29e"} Jul 06 13:47:09.043544 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:09.043535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhb5t" event={"ID":"50d50b74-72bf-4088-87f7-efdcb344cd51","Type":"ContainerStarted","Data":"2e8e5b35d1a730d575b88b21cb8753ce0b40ecebd83c04fc1acab9c4c1cb2c47"} Jul 06 13:47:09.063992 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:09.063937 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dhb5t" podStartSLOduration=130.920313716 podStartE2EDuration="2m12.063923116s" totalImagesPullingTime="1.1436094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:09.063310199 +0000 UTC m=+132.032898444" watchObservedRunningTime="2026-07-06 13:47:09.063923116 +0000 UTC m=+132.033511416" Jul 06 13:47:16.711426 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:16.711391 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" podUID="562900ef-572a-4aea-9f3f-33fd6399731c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 13:47:26.710371 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:26.710329 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" podUID="562900ef-572a-4aea-9f3f-33fd6399731c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 13:47:26.710842 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:26.710397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" Jul 06 13:47:26.710886 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:26.710856 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5da776d1266f5939d58a00336838288b6ab24a4cd8d7dfc5981bfabb44945c94"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 06 13:47:26.710925 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:26.710905 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" podUID="562900ef-572a-4aea-9f3f-33fd6399731c" containerName="service-proxy" containerID="cri-o://5da776d1266f5939d58a00336838288b6ab24a4cd8d7dfc5981bfabb44945c94" gracePeriod=30 Jul 06 13:47:27.103938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:27.103852 2581 generic.go:356] "Generic (PLEG): container finished" podID="562900ef-572a-4aea-9f3f-33fd6399731c" containerID="5da776d1266f5939d58a00336838288b6ab24a4cd8d7dfc5981bfabb44945c94" exitCode=2 Jul 06 13:47:27.103938 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:27.103919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerDied","Data":"5da776d1266f5939d58a00336838288b6ab24a4cd8d7dfc5981bfabb44945c94"} Jul 06 13:47:27.104175 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:27.103953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86c7bc45cc-zdbhg" event={"ID":"562900ef-572a-4aea-9f3f-33fd6399731c","Type":"ContainerStarted","Data":"d6f815dfdf65164a89a9cbe4d8c8ea83bfad685c2c98de22b24ce63bee20016c"} Jul 06 13:47:32.280986 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.280935 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerName="registry" containerID="cri-o://f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555" gracePeriod=30 Jul 06 13:47:32.515655 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.515630 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:47:32.603978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.603899 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.603978 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.603948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.603989 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604014 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604031 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604051 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5nmp\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604072 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604192 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604097 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted\") pod \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\" (UID: \"7137c802-5268-4d0d-a71a-1b52dd5b68b1\") " Jul 06 13:47:32.604512 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604400 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:32.604512 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.604412 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:47:32.606783 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.606755 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:32.606910 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.606802 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:32.606910 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.606868 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp" (OuterVolumeSpecName: "kube-api-access-q5nmp") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "kube-api-access-q5nmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:47:32.607002 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.606935 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:32.607050 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.607026 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:47:32.613059 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.613038 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7137c802-5268-4d0d-a71a-1b52dd5b68b1" (UID: "7137c802-5268-4d0d-a71a-1b52dd5b68b1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:47:32.705507 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705472 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-certificates\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705507 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705500 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7137c802-5268-4d0d-a71a-1b52dd5b68b1-trusted-ca\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705507 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705511 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-image-registry-private-configuration\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705720 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705520 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-bound-sa-token\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705720 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705528 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-registry-tls\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705720 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705539 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5nmp\" (UniqueName: \"kubernetes.io/projected/7137c802-5268-4d0d-a71a-1b52dd5b68b1-kube-api-access-q5nmp\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705720 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705546 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7137c802-5268-4d0d-a71a-1b52dd5b68b1-installation-pull-secrets\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:32.705720 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:32.705554 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7137c802-5268-4d0d-a71a-1b52dd5b68b1-ca-trust-extracted\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 13:47:33.128791 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.128759 2581 generic.go:356] "Generic (PLEG): container finished" podID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerID="f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555" exitCode=0 Jul 06 13:47:33.128967 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.128794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" event={"ID":"7137c802-5268-4d0d-a71a-1b52dd5b68b1","Type":"ContainerDied","Data":"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555"} Jul 06 13:47:33.128967 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.128825 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" Jul 06 13:47:33.128967 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.128889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fbfcd855c-jnqhz" event={"ID":"7137c802-5268-4d0d-a71a-1b52dd5b68b1","Type":"ContainerDied","Data":"efdee26445a2c21101edd92e09454904d10c61f343d7b0d2eec9e8c49dd5b7e1"} Jul 06 13:47:33.128967 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.128928 2581 scope.go:117] "RemoveContainer" containerID="f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555" Jul 06 13:47:33.137146 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.137130 2581 scope.go:117] "RemoveContainer" containerID="f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555" Jul 06 13:47:33.137425 ip-10-0-143-72 kubenswrapper[2581]: E0706 13:47:33.137406 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555\": container with ID starting with f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555 not found: ID does not exist" containerID="f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555" Jul 06 13:47:33.137480 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.137432 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555"} err="failed to get container status \"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555\": rpc error: code = NotFound desc = could not find container \"f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555\": container with ID starting with f1c4a09e6a98c98f39ce04cc47ede39b57fc7b5db4a90969fd9f99823e4c2555 not found: ID does not exist" Jul 06 13:47:33.151911 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.151889 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:47:33.155831 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.155811 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fbfcd855c-jnqhz"] Jul 06 13:47:33.510308 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:47:33.510276 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" path="/var/lib/kubelet/pods/7137c802-5268-4d0d-a71a-1b52dd5b68b1/volumes" Jul 06 13:49:57.424375 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:49:57.424349 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 13:50:13.039886 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.039851 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449"] Jul 06 13:50:13.042334 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.040187 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerName="registry" Jul 06 13:50:13.042334 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.040206 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerName="registry" Jul 06 13:50:13.042334 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.040290 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7137c802-5268-4d0d-a71a-1b52dd5b68b1" containerName="registry" Jul 06 13:50:13.043138 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.043120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.046898 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.046872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449"] Jul 06 13:50:13.047109 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.047090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4gntp\"" Jul 06 13:50:13.047221 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.047105 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 13:50:13.047221 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.047105 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:50:13.102899 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.102869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csbsw\" (UniqueName: \"kubernetes.io/projected/0e1545d0-c732-4de7-b3f2-99b7117c744b-kube-api-access-csbsw\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.103040 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.102909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e1545d0-c732-4de7-b3f2-99b7117c744b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.203797 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.203763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csbsw\" (UniqueName: \"kubernetes.io/projected/0e1545d0-c732-4de7-b3f2-99b7117c744b-kube-api-access-csbsw\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.203942 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.203805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e1545d0-c732-4de7-b3f2-99b7117c744b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.204135 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.204120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e1545d0-c732-4de7-b3f2-99b7117c744b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.214153 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.214128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csbsw\" (UniqueName: \"kubernetes.io/projected/0e1545d0-c732-4de7-b3f2-99b7117c744b-kube-api-access-csbsw\") pod \"openshift-lws-operator-fd8ccff4c-sw449\" (UID: \"0e1545d0-c732-4de7-b3f2-99b7117c744b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.352383 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.352300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" Jul 06 13:50:13.475102 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.475071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449"] Jul 06 13:50:13.478361 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:50:13.478335 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e1545d0_c732_4de7_b3f2_99b7117c744b.slice/crio-8a4ebe11054dac94e3b64bfa4aa7aee887692453edd35e0a4e1c0823a350c376 WatchSource:0}: Error finding container 8a4ebe11054dac94e3b64bfa4aa7aee887692453edd35e0a4e1c0823a350c376: Status 404 returned error can't find the container with id 8a4ebe11054dac94e3b64bfa4aa7aee887692453edd35e0a4e1c0823a350c376 Jul 06 13:50:13.479760 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.479742 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:50:13.642667 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:13.642577 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" event={"ID":"0e1545d0-c732-4de7-b3f2-99b7117c744b","Type":"ContainerStarted","Data":"8a4ebe11054dac94e3b64bfa4aa7aee887692453edd35e0a4e1c0823a350c376"} Jul 06 13:50:16.656289 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:16.656187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" event={"ID":"0e1545d0-c732-4de7-b3f2-99b7117c744b","Type":"ContainerStarted","Data":"05cb7d2c196d1e02930b18bb8971cfca901d244dfe0ff669d7f23e12d6f349ca"} Jul 06 13:50:16.673747 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:16.673706 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sw449" podStartSLOduration=0.942749294 podStartE2EDuration="3.673691465s" totalImagesPullingTime="2.730942171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:16.672816679 +0000 UTC m=+319.642404938" watchObservedRunningTime="2026-07-06 13:50:16.673691465 +0000 UTC m=+319.643279707" Jul 06 13:50:34.171026 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.170994 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5"] Jul 06 13:50:34.180406 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.180384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.183575 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.183552 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 13:50:34.183694 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.183596 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 13:50:34.185826 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.185807 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 13:50:34.185974 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.185956 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kc44z\"" Jul 06 13:50:34.186268 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.186254 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 13:50:34.190154 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.190131 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5"] Jul 06 13:50:34.235264 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.235213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.235411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.235298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxgb\" (UniqueName: \"kubernetes.io/projected/81852daf-1c10-4fe8-9483-8d99e92234b3-kube-api-access-khxgb\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.235411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.235327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.235411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.235369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.235411 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.235388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336086 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336303 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khxgb\" (UniqueName: \"kubernetes.io/projected/81852daf-1c10-4fe8-9483-8d99e92234b3-kube-api-access-khxgb\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336303 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336303 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336303 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.336593 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.336556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.338497 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.338476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81852daf-1c10-4fe8-9483-8d99e92234b3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.338700 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.338684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.338766 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.338721 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81852daf-1c10-4fe8-9483-8d99e92234b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.350586 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.350561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxgb\" (UniqueName: \"kubernetes.io/projected/81852daf-1c10-4fe8-9483-8d99e92234b3-kube-api-access-khxgb\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-g85b5\" (UID: \"81852daf-1c10-4fe8-9483-8d99e92234b3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.491648 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.491617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:34.622803 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.622775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5"] Jul 06 13:50:34.625438 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:50:34.625415 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81852daf_1c10_4fe8_9483_8d99e92234b3.slice/crio-f3ed9270489891cc7e0f367b3903597e7685a08d9ac9ab19282db7fc06e4a1ec WatchSource:0}: Error finding container f3ed9270489891cc7e0f367b3903597e7685a08d9ac9ab19282db7fc06e4a1ec: Status 404 returned error can't find the container with id f3ed9270489891cc7e0f367b3903597e7685a08d9ac9ab19282db7fc06e4a1ec Jul 06 13:50:34.719198 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:34.719167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" event={"ID":"81852daf-1c10-4fe8-9483-8d99e92234b3","Type":"ContainerStarted","Data":"f3ed9270489891cc7e0f367b3903597e7685a08d9ac9ab19282db7fc06e4a1ec"} Jul 06 13:50:37.733350 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:37.733314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" event={"ID":"81852daf-1c10-4fe8-9483-8d99e92234b3","Type":"ContainerStarted","Data":"871e34ec54728995a88e77b0f3b2cab7bb2a7996b6c69c0808185b4453430500"} Jul 06 13:50:38.738454 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:38.738425 2581 generic.go:356] "Generic (PLEG): container finished" podID="81852daf-1c10-4fe8-9483-8d99e92234b3" containerID="871e34ec54728995a88e77b0f3b2cab7bb2a7996b6c69c0808185b4453430500" exitCode=0 Jul 06 13:50:38.738814 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:38.738507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" event={"ID":"81852daf-1c10-4fe8-9483-8d99e92234b3","Type":"ContainerDied","Data":"871e34ec54728995a88e77b0f3b2cab7bb2a7996b6c69c0808185b4453430500"} Jul 06 13:50:39.743857 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:39.743828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" event={"ID":"81852daf-1c10-4fe8-9483-8d99e92234b3","Type":"ContainerStarted","Data":"900fa4a8848fea80be2a6661678eb0dbe4d69754f2b9bb10ce64a4790c6d179c"} Jul 06 13:50:39.744257 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:39.743961 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:39.766025 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:39.765968 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" podStartSLOduration=1.415494915 podStartE2EDuration="5.765948752s" totalImagesPullingTime="3.27182065s" totalInitContainerRuntime="1.078633187s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:39.764485442 +0000 UTC m=+342.734073685" watchObservedRunningTime="2026-07-06 13:50:39.765948752 +0000 UTC m=+342.735536994" Jul 06 13:50:50.749665 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:50.749587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-g85b5" Jul 06 13:50:52.180295 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.180261 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-f2c46"] Jul 06 13:50:52.183070 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.183053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.186054 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.186027 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 13:50:52.187371 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.187354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 13:50:52.187446 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.187356 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 13:50:52.187446 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.187356 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m76dr\"" Jul 06 13:50:52.193987 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.193965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-f2c46"] Jul 06 13:50:52.267118 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.267082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-metrics-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.267118 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.267121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggms6\" (UniqueName: \"kubernetes.io/projected/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-kube-api-access-ggms6\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.267360 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.267164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-manager-config\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.267360 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.267204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.367778 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.367741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-metrics-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.367778 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.367779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggms6\" (UniqueName: \"kubernetes.io/projected/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-kube-api-access-ggms6\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.368040 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.367808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-manager-config\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.368040 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.367827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.368503 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.368484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-manager-config\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.370425 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.370402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-metrics-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.370513 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.370444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-cert\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.378833 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.378800 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggms6\" (UniqueName: \"kubernetes.io/projected/a77b3f43-ca82-4e4f-a409-8b0705a3cf89-kube-api-access-ggms6\") pod \"lws-controller-manager-665d757866-f2c46\" (UID: \"a77b3f43-ca82-4e4f-a409-8b0705a3cf89\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.492078 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.491983 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:52.632222 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.632197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-f2c46"] Jul 06 13:50:52.634751 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:50:52.634721 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b3f43_ca82_4e4f_a409_8b0705a3cf89.slice/crio-16a0bfd86a30c3f138ce1b5b0d657edd09e8d0206ae63940d8326e58b651c29b WatchSource:0}: Error finding container 16a0bfd86a30c3f138ce1b5b0d657edd09e8d0206ae63940d8326e58b651c29b: Status 404 returned error can't find the container with id 16a0bfd86a30c3f138ce1b5b0d657edd09e8d0206ae63940d8326e58b651c29b Jul 06 13:50:52.789288 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:52.789195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" event={"ID":"a77b3f43-ca82-4e4f-a409-8b0705a3cf89","Type":"ContainerStarted","Data":"16a0bfd86a30c3f138ce1b5b0d657edd09e8d0206ae63940d8326e58b651c29b"} Jul 06 13:50:54.799222 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:54.799109 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" event={"ID":"a77b3f43-ca82-4e4f-a409-8b0705a3cf89","Type":"ContainerStarted","Data":"3dd6cd5df2d22bc9efd1d45be6df8602927286312b773c6efc1a61bb96b77f01"} Jul 06 13:50:54.799709 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:54.799264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:50:54.818174 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:50:54.818110 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" podStartSLOduration=0.995044719 podStartE2EDuration="2.818088607s" totalImagesPullingTime="1.823043888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:54.816790425 +0000 UTC m=+357.786378669" watchObservedRunningTime="2026-07-06 13:50:54.818088607 +0000 UTC m=+357.787676854" Jul 06 13:51:00.905661 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.905625 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf"] Jul 06 13:51:00.910410 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.910389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:00.913293 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 13:51:00.913416 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 13:51:00.913416 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913378 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 13:51:00.913549 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913426 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 13:51:00.913729 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913715 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 13:51:00.913922 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913906 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 13:51:00.914021 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.913955 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tfdst\"" Jul 06 13:51:00.924367 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:00.924347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf"] Jul 06 13:51:01.038941 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.038907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.038941 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.038941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.039143 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.038967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.039143 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.039020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfwbm\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-kube-api-access-vfwbm\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.039143 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.039099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec493e4-1d45-4ac1-85ba-b479d97f7334-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.039143 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.039134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.039295 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.039159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140280 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfwbm\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-kube-api-access-vfwbm\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140280 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec493e4-1d45-4ac1-85ba-b479d97f7334-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140513 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140513 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140621 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140621 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.140621 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.140594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.141171 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.141145 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.142694 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.142664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec493e4-1d45-4ac1-85ba-b479d97f7334-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.142807 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.142796 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.142898 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.142882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.142961 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.142922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eec493e4-1d45-4ac1-85ba-b479d97f7334-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.158869 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.158814 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.159964 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.159940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfwbm\" (UniqueName: \"kubernetes.io/projected/eec493e4-1d45-4ac1-85ba-b479d97f7334-kube-api-access-vfwbm\") pod \"istiod-openshift-gateway-94bb8fbfd-675xf\" (UID: \"eec493e4-1d45-4ac1-85ba-b479d97f7334\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.219778 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.219742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:01.361530 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.361505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf"] Jul 06 13:51:01.363854 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:51:01.363824 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec493e4_1d45_4ac1_85ba_b479d97f7334.slice/crio-a72dd171b770d71de2ec695943d5de56a3d455440e788facdda5cc085f669a2c WatchSource:0}: Error finding container a72dd171b770d71de2ec695943d5de56a3d455440e788facdda5cc085f669a2c: Status 404 returned error can't find the container with id a72dd171b770d71de2ec695943d5de56a3d455440e788facdda5cc085f669a2c Jul 06 13:51:01.824337 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:01.824303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" event={"ID":"eec493e4-1d45-4ac1-85ba-b479d97f7334","Type":"ContainerStarted","Data":"a72dd171b770d71de2ec695943d5de56a3d455440e788facdda5cc085f669a2c"} Jul 06 13:51:03.989333 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:03.989290 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 13:51:03.989625 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:03.989374 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 13:51:04.838410 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:04.838376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" event={"ID":"eec493e4-1d45-4ac1-85ba-b479d97f7334","Type":"ContainerStarted","Data":"09543598b4481d2ac4b48f77ea9e477244fa092058b5a95a47703412d1191cec"} Jul 06 13:51:04.838593 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:04.838479 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:51:04.892043 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:04.891991 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" podStartSLOduration=2.268758551 podStartE2EDuration="4.89196765s" totalImagesPullingTime="2.623209099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:04.891518847 +0000 UTC m=+367.861107091" watchObservedRunningTime="2026-07-06 13:51:04.89196765 +0000 UTC m=+367.861555895" Jul 06 13:51:05.805628 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:05.805597 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-665d757866-f2c46" Jul 06 13:51:05.844433 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:51:05.844405 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-675xf" Jul 06 13:53:29.635278 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.635243 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:53:29.638361 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.638341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.640905 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.640879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 13:53:29.641042 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.641021 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 13:53:29.642302 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.642282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nhp6c\"" Jul 06 13:53:29.642398 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.642305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 13:53:29.645491 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.645436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:53:29.671348 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.671322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:53:29.717658 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.717633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrc8\" (UniqueName: \"kubernetes.io/projected/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-kube-api-access-qhrc8\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.717776 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.717682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-config-file\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.818063 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.818010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-config-file\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.818063 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.818079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrc8\" (UniqueName: \"kubernetes.io/projected/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-kube-api-access-qhrc8\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.818676 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.818657 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-config-file\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.826218 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.826195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrc8\" (UniqueName: \"kubernetes.io/projected/40307d11-cbc4-4e7c-b06e-a9c0b77a0cac-kube-api-access-qhrc8\") pod \"limitador-limitador-54d6d988d5-h72pr\" (UID: \"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:29.948824 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:29.948790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:30.075478 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:30.075443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:53:30.078122 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:53:30.078098 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40307d11_cbc4_4e7c_b06e_a9c0b77a0cac.slice/crio-7e82001dec24a02cdf5cca64d0933a5f9ceffd8c3988499b50720364b127f157 WatchSource:0}: Error finding container 7e82001dec24a02cdf5cca64d0933a5f9ceffd8c3988499b50720364b127f157: Status 404 returned error can't find the container with id 7e82001dec24a02cdf5cca64d0933a5f9ceffd8c3988499b50720364b127f157 Jul 06 13:53:30.336313 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:30.336221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" event={"ID":"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac","Type":"ContainerStarted","Data":"7e82001dec24a02cdf5cca64d0933a5f9ceffd8c3988499b50720364b127f157"} Jul 06 13:53:33.353823 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:33.353787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" event={"ID":"40307d11-cbc4-4e7c-b06e-a9c0b77a0cac","Type":"ContainerStarted","Data":"5fa81db54d78d781e4f40a30a27942d1f6b8289f4132352a03c339daff9d4469"} Jul 06 13:53:33.354216 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:33.353884 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:53:33.372706 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:33.372659 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" podStartSLOduration=1.896580011 podStartE2EDuration="4.372644796s" totalImagesPullingTime="2.476064785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:33.372329948 +0000 UTC m=+516.341918191" watchObservedRunningTime="2026-07-06 13:53:33.372644796 +0000 UTC m=+516.342233038" Jul 06 13:53:44.358482 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:53:44.358449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h72pr" Jul 06 13:54:40.044453 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:54:40.044416 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:00.381016 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:00.380979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:08.148965 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:08.148931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:15.670616 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.670587 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg"] Jul 06 13:55:15.673964 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.673930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.676703 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.676680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-96n6p\"" Jul 06 13:55:15.677129 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.677111 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 13:55:15.678210 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.678192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 13:55:15.678294 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.678242 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 13:55:15.688486 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.688467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg"] Jul 06 13:55:15.859220 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b428971-001f-4737-860e-9cee3f0c5d04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.859394 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.859394 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdrs2\" (UniqueName: \"kubernetes.io/projected/9b428971-001f-4737-860e-9cee3f0c5d04-kube-api-access-jdrs2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.859394 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.859394 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.859394 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.859392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960288 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960441 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960441 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960441 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b428971-001f-4737-860e-9cee3f0c5d04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960603 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960603 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdrs2\" (UniqueName: \"kubernetes.io/projected/9b428971-001f-4737-860e-9cee3f0c5d04-kube-api-access-jdrs2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960733 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960790 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.960830 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.960788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.962456 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.962433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b428971-001f-4737-860e-9cee3f0c5d04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.962744 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.962728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b428971-001f-4737-860e-9cee3f0c5d04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.973041 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.973015 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdrs2\" (UniqueName: \"kubernetes.io/projected/9b428971-001f-4737-860e-9cee3f0c5d04-kube-api-access-jdrs2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6tgcg\" (UID: \"9b428971-001f-4737-860e-9cee3f0c5d04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:15.983912 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:15.983893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:16.109150 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:16.109126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg"] Jul 06 13:55:16.111707 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:55:16.111682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b428971_001f_4737_860e_9cee3f0c5d04.slice/crio-290dddb637ac5b53e4967d66f90a847a9f581e945c37cb59b6fea5f824ac9cd7 WatchSource:0}: Error finding container 290dddb637ac5b53e4967d66f90a847a9f581e945c37cb59b6fea5f824ac9cd7: Status 404 returned error can't find the container with id 290dddb637ac5b53e4967d66f90a847a9f581e945c37cb59b6fea5f824ac9cd7 Jul 06 13:55:16.112953 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:16.112937 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:55:16.703515 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:16.703468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" event={"ID":"9b428971-001f-4737-860e-9cee3f0c5d04","Type":"ContainerStarted","Data":"290dddb637ac5b53e4967d66f90a847a9f581e945c37cb59b6fea5f824ac9cd7"} Jul 06 13:55:16.734087 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:16.734063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:17.710782 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:17.710724 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" event={"ID":"9b428971-001f-4737-860e-9cee3f0c5d04","Type":"ContainerStarted","Data":"c9f46f48842ace9d52f1f1758b179251f8b30c26841232b0ce88e4bbe10beabf"} Jul 06 13:55:17.730786 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:17.730739 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" podStartSLOduration=1.353656215 podStartE2EDuration="2.73072641s" totalImagesPullingTime="1.377070195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:17.729695458 +0000 UTC m=+620.699283700" watchObservedRunningTime="2026-07-06 13:55:17.73072641 +0000 UTC m=+620.700314653" Jul 06 13:55:20.820998 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:20.820918 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:25.984412 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:25.984362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:25.984412 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:25.984425 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:25.996660 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:25.996633 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:26.754732 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:26.754701 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6tgcg" Jul 06 13:55:32.673201 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.673166 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg"] Jul 06 13:55:32.678845 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.678823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.681810 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.681792 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 13:55:32.691912 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.691878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg"] Jul 06 13:55:32.790078 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.790348 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.790449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.790449 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9931bdc4-2312-4353-9df3-a30e13df7916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.790629 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.790679 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.790641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sct7\" (UniqueName: \"kubernetes.io/projected/9931bdc4-2312-4353-9df3-a30e13df7916-kube-api-access-9sct7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891501 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sct7\" (UniqueName: \"kubernetes.io/projected/9931bdc4-2312-4353-9df3-a30e13df7916-kube-api-access-9sct7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9931bdc4-2312-4353-9df3-a30e13df7916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.891765 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.892017 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.892017 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.891985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.892122 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.892099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.893864 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.893846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9931bdc4-2312-4353-9df3-a30e13df7916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.894121 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.894104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9931bdc4-2312-4353-9df3-a30e13df7916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.899522 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.899497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sct7\" (UniqueName: \"kubernetes.io/projected/9931bdc4-2312-4353-9df3-a30e13df7916-kube-api-access-9sct7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4vxxg\" (UID: \"9931bdc4-2312-4353-9df3-a30e13df7916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:32.988110 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:32.988028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:33.116157 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:33.116039 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg"] Jul 06 13:55:33.118111 ip-10-0-143-72 kubenswrapper[2581]: W0706 13:55:33.118080 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9931bdc4_2312_4353_9df3_a30e13df7916.slice/crio-e293e41026a0f9ea162488c5191c61ab672caeb8186e1c9a1fdd873cffb3aadf WatchSource:0}: Error finding container e293e41026a0f9ea162488c5191c61ab672caeb8186e1c9a1fdd873cffb3aadf: Status 404 returned error can't find the container with id e293e41026a0f9ea162488c5191c61ab672caeb8186e1c9a1fdd873cffb3aadf Jul 06 13:55:33.769894 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:33.769861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" event={"ID":"9931bdc4-2312-4353-9df3-a30e13df7916","Type":"ContainerStarted","Data":"966ca9b9b7990fe92434a7b60300936e74bb452d08875ae14299232172303ea0"} Jul 06 13:55:33.770322 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:33.769915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" event={"ID":"9931bdc4-2312-4353-9df3-a30e13df7916","Type":"ContainerStarted","Data":"e293e41026a0f9ea162488c5191c61ab672caeb8186e1c9a1fdd873cffb3aadf"} Jul 06 13:55:33.789144 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:33.789099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" podStartSLOduration=1.573067016 podStartE2EDuration="1.789084473s" totalImagesPullingTime="216.017457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:33.787430361 +0000 UTC m=+636.757018604" watchObservedRunningTime="2026-07-06 13:55:33.789084473 +0000 UTC m=+636.758672693" Jul 06 13:55:34.523946 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:34.523915 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:55:42.988602 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:42.988570 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:42.988983 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:42.988624 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:43.001122 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:43.001097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:43.823390 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:43.823360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4vxxg" Jul 06 13:55:49.226722 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:55:49.226691 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:56:50.924913 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:56:50.924832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:57:01.230983 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:57:01.230948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:57:12.419375 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:57:12.419345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:57:21.133915 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:57:21.133880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:57:31.627182 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:57:31.627151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:58:02.420492 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:58:02.420450 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:58:13.822726 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:58:13.822692 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:58:47.623344 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:58:47.623313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:58:57.409515 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:58:57.409482 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:05.528209 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:05.528172 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:15.729808 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:15.729775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:26.121319 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:26.121289 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:37.518601 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:37.518567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:48.516960 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:48.516930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 13:59:55.619939 ip-10-0-143-72 kubenswrapper[2581]: I0706 13:59:55.619910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:00:02.821524 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:00:02.821490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:00:11.415541 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:00:11.415506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:00:24.322520 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:00:24.322481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:00:32.919868 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:00:32.919836 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:00:56.420048 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:00:56.420015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:07.614795 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:07.614768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:22.225575 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:22.225499 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:32.523004 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:32.522970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:41.328418 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:41.328382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:51.629830 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:51.629790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:01:59.839812 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:01:59.839776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:03:49.972558 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:03:49.972525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:00.981083 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:00.981045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:11.565124 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:11.565093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:21.874748 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:21.874669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:32.574928 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:32.574894 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:43.875077 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:43.875047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:04:52.274870 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:04:52.274834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:05:02.766797 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:05:02.766763 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:05:15.068424 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:05:15.068389 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:05:23.371635 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:05:23.371591 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:05:33.875435 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:05:33.875402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:05:39.075744 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:05:39.075706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:04.879696 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:04.879663 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:12.271709 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:12.271681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:21.680394 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:21.680361 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:33.573652 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:33.573616 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:49.078689 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:49.078654 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:06:58.965504 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:06:58.965466 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:08.279894 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:08.279857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:18.183572 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:18.183534 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:26.776590 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:26.776503 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:36.176940 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:36.176906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:48.973366 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:48.973332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:07:57.781817 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:07:57.781784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:08:06.683185 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:08:06.683157 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:08:17.869747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:08:17.869704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:08:27.173722 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:08:27.173687 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:08:37.575437 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:08:37.575409 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:08:48.678090 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:08:48.678053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:09:00.574596 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:09:00.574555 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:09:13.268042 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:09:13.268008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:09:28.479822 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:09:28.479794 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:09:36.870920 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:09:36.870884 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:11:31.866560 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:11:31.866527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:11:40.375471 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:11:40.375429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:11:53.979147 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:11:53.979070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:12:02.077165 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:12:02.077127 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:12:33.580942 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:12:33.580910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:12:44.378430 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:12:44.378396 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:12:59.870934 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:12:59.870899 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:13:09.276317 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:13:09.276283 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:13:21.671757 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:13:21.671681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:13:55.780891 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:13:55.780860 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:14:09.578176 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:14:09.578140 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:14:23.186277 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:14:23.186246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:15:10.772857 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:15:10.772817 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:15:21.291126 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:15:21.291089 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:15:40.187506 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:15:40.187469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:16:11.185859 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:16:11.185820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:16:30.396307 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:16:30.396217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:16:54.327576 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:16:54.327540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:07.094563 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:07.094527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:18.094176 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:18.094142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:29.892345 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:29.892308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:40.388829 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:40.388794 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:51.640667 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:51.640590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:17:59.788779 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:17:59.788746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:18:11.482771 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:11.482736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:18:22.475430 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.475401 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:18:22.478458 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.478439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.482719 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.482693 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"auth-test-model-74bb89-kserve-self-signed-certs\"" Jul 06 14:18:22.482838 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.482746 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"default-dockercfg-6ql69\"" Jul 06 14:18:22.482838 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.482786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"openshift-service-ca.crt\"" Jul 06 14:18:22.482838 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.482749 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"kube-root-ca.crt\"" Jul 06 14:18:22.488290 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.488268 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:18:22.598495 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.598662 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr6hf\" (UniqueName: \"kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.598662 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.598662 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.598783 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.598783 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.598683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.699898 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.699866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.699898 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.699899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700150 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.699929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700150 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr6hf\" (UniqueName: \"kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700150 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700150 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700412 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700383 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700557 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.700557 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.700488 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.702178 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.702158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.702355 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.702340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.709036 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.709019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr6hf\" (UniqueName: \"kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf\") pod \"auth-test-model-74bb89-kserve-57c5d5894c-pzrkc\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.790963 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.790901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:22.916162 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.916139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:18:22.918821 ip-10-0-143-72 kubenswrapper[2581]: W0706 14:18:22.918795 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74c57d3d_c55f_4453_9237_5645d96a7eac.slice/crio-1069f91efa299e10e61a222dd5343d71536c9867d8c96c9e3605b3bcfd42b1c8 WatchSource:0}: Error finding container 1069f91efa299e10e61a222dd5343d71536c9867d8c96c9e3605b3bcfd42b1c8: Status 404 returned error can't find the container with id 1069f91efa299e10e61a222dd5343d71536c9867d8c96c9e3605b3bcfd42b1c8 Jul 06 14:18:22.997005 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.996970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" event={"ID":"74c57d3d-c55f-4453-9237-5645d96a7eac","Type":"ContainerStarted","Data":"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6"} Jul 06 14:18:22.997116 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:22.997016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" event={"ID":"74c57d3d-c55f-4453-9237-5645d96a7eac","Type":"ContainerStarted","Data":"1069f91efa299e10e61a222dd5343d71536c9867d8c96c9e3605b3bcfd42b1c8"} Jul 06 14:18:23.018000 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:23.017955 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" podStartSLOduration=1.017930425 podStartE2EDuration="1.017930425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:18:23.016280906 +0000 UTC m=+2005.985869161" watchObservedRunningTime="2026-07-06 14:18:23.017930425 +0000 UTC m=+2005.987518667" Jul 06 14:18:24.680443 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:24.680413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:18:32.791224 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:32.791182 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:32.791711 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:32.791268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:32.803355 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:32.803332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:33.049076 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:33.048959 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:18:53.076581 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:18:53.076551 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:19:08.271988 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:19:08.271954 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:19:25.073149 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:19:25.073073 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:19:39.577946 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:19:39.577900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:19:56.774016 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:19:56.773984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:20:13.388353 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:13.388316 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:20:28.488205 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:28.483344 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:20:30.576940 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:30.576901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:20:43.504808 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.504747 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" podUID="74c57d3d-c55f-4453-9237-5645d96a7eac" containerName="main" containerID="cri-o://275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6" gracePeriod=45 Jul 06 14:20:43.745380 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.745357 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:20:43.875487 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875487 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875453 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875721 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875491 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr6hf\" (UniqueName: \"kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875721 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875507 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875721 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875532 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875721 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875563 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache\") pod \"74c57d3d-c55f-4453-9237-5645d96a7eac\" (UID: \"74c57d3d-c55f-4453-9237-5645d96a7eac\") " Jul 06 14:20:43.875936 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875811 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home" (OuterVolumeSpecName: "home") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:43.875936 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875856 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:43.875936 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.875879 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache" (OuterVolumeSpecName: "model-cache") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:43.877632 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.877610 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf" (OuterVolumeSpecName: "kube-api-access-sr6hf") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "kube-api-access-sr6hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:20:43.877757 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.877645 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm" (OuterVolumeSpecName: "dshm") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:20:43.877757 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.877705 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74c57d3d-c55f-4453-9237-5645d96a7eac" (UID: "74c57d3d-c55f-4453-9237-5645d96a7eac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:20:43.976747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976702 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-model-cache\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.976747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976737 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-dshm\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.976747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976745 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-home\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.976747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976754 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr6hf\" (UniqueName: \"kubernetes.io/projected/74c57d3d-c55f-4453-9237-5645d96a7eac-kube-api-access-sr6hf\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.976747 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976763 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c57d3d-c55f-4453-9237-5645d96a7eac-tls-certs\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:43.977040 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:43.976772 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74c57d3d-c55f-4453-9237-5645d96a7eac-tmp-dir\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:20:44.554499 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.554464 2581 generic.go:356] "Generic (PLEG): container finished" podID="74c57d3d-c55f-4453-9237-5645d96a7eac" containerID="275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6" exitCode=0 Jul 06 14:20:44.554983 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.554510 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" Jul 06 14:20:44.554983 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.554546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" event={"ID":"74c57d3d-c55f-4453-9237-5645d96a7eac","Type":"ContainerDied","Data":"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6"} Jul 06 14:20:44.554983 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.554583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc" event={"ID":"74c57d3d-c55f-4453-9237-5645d96a7eac","Type":"ContainerDied","Data":"1069f91efa299e10e61a222dd5343d71536c9867d8c96c9e3605b3bcfd42b1c8"} Jul 06 14:20:44.554983 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.554603 2581 scope.go:117] "RemoveContainer" containerID="275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6" Jul 06 14:20:44.562608 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.562593 2581 scope.go:117] "RemoveContainer" containerID="275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6" Jul 06 14:20:44.562868 ip-10-0-143-72 kubenswrapper[2581]: E0706 14:20:44.562848 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6\": container with ID starting with 275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6 not found: ID does not exist" containerID="275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6" Jul 06 14:20:44.562958 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.562873 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6"} err="failed to get container status \"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6\": rpc error: code = NotFound desc = could not find container \"275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6\": container with ID starting with 275a582a9728cee17b609175ec3d2e497182ce46a7caa7282367a17c61004cd6 not found: ID does not exist" Jul 06 14:20:44.574897 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.574851 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:20:44.578862 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:44.578843 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/auth-test-model-74bb89-kserve-57c5d5894c-pzrkc"] Jul 06 14:20:45.510795 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:45.510763 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c57d3d-c55f-4453-9237-5645d96a7eac" path="/var/lib/kubelet/pods/74c57d3d-c55f-4453-9237-5645d96a7eac/volumes" Jul 06 14:20:49.880954 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:20:49.880881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:21:08.982055 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:08.982023 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:21:31.769219 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:31.769186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:21:49.584000 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:49.583968 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:21:58.987165 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.987137 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:21:58.987543 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.987422 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c57d3d-c55f-4453-9237-5645d96a7eac" containerName="main" Jul 06 14:21:58.987543 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.987433 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c57d3d-c55f-4453-9237-5645d96a7eac" containerName="main" Jul 06 14:21:58.987543 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.987501 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c57d3d-c55f-4453-9237-5645d96a7eac" containerName="main" Jul 06 14:21:58.990205 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.990184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:58.994933 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.994906 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"openshift-service-ca.crt\"" Jul 06 14:21:58.995101 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.994988 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"kube-root-ca.crt\"" Jul 06 14:21:58.995175 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.995145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"rate-test-model-0ba2b8-kserve-self-signed-certs\"" Jul 06 14:21:58.995301 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:58.995281 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0ba2b8\"/\"default-dockercfg-82tgw\"" Jul 06 14:21:59.001255 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.001213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:21:59.126953 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.126922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.126953 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.126954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.127140 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.126975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.127140 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.126992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.127140 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.127056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.127140 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.127081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbbs\" (UniqueName: \"kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228324 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228324 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228541 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228541 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228541 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228541 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbbs\" (UniqueName: \"kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228857 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.228857 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.229010 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.228895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.230661 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.230641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.230894 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.230878 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.237753 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.237691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbbs\" (UniqueName: \"kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs\") pod \"rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.302506 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.302474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:21:59.442643 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.442614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:21:59.445431 ip-10-0-143-72 kubenswrapper[2581]: W0706 14:21:59.445405 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b7bcdde_0f52_4068_8af9_12b8a530d2c7.slice/crio-f2cb85640e910eef1f183e600339ea0ee892b485888e12b146aa35be72840d35 WatchSource:0}: Error finding container f2cb85640e910eef1f183e600339ea0ee892b485888e12b146aa35be72840d35: Status 404 returned error can't find the container with id f2cb85640e910eef1f183e600339ea0ee892b485888e12b146aa35be72840d35 Jul 06 14:21:59.833977 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.833884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" event={"ID":"4b7bcdde-0f52-4068-8af9-12b8a530d2c7","Type":"ContainerStarted","Data":"814f0c1dd07be46e26e32f59e6e9c8d89c188aee420b11f41a85d7fd9e1fc587"} Jul 06 14:21:59.833977 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.833924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" event={"ID":"4b7bcdde-0f52-4068-8af9-12b8a530d2c7","Type":"ContainerStarted","Data":"f2cb85640e910eef1f183e600339ea0ee892b485888e12b146aa35be72840d35"} Jul 06 14:21:59.853308 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:21:59.853261 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" podStartSLOduration=1.853220135 podStartE2EDuration="1.853220135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:59.852219012 +0000 UTC m=+2222.821807253" watchObservedRunningTime="2026-07-06 14:21:59.853220135 +0000 UTC m=+2222.822808377" Jul 06 14:22:05.879010 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:05.878977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:22:09.303271 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:09.303211 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:22:09.303810 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:09.303284 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:22:09.315827 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:09.315800 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:22:09.884867 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:09.884839 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:22:39.284875 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:22:39.284839 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:23:05.875966 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:05.875931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:23:19.371703 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:19.371670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:23:26.970478 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:26.970436 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:23:32.472201 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:32.472167 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:23:41.990076 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:41.990018 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" podUID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" containerName="main" containerID="cri-o://814f0c1dd07be46e26e32f59e6e9c8d89c188aee420b11f41a85d7fd9e1fc587" gracePeriod=45 Jul 06 14:23:42.220310 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.220192 2581 generic.go:356] "Generic (PLEG): container finished" podID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" containerID="814f0c1dd07be46e26e32f59e6e9c8d89c188aee420b11f41a85d7fd9e1fc587" exitCode=0 Jul 06 14:23:42.220310 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.220264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" event={"ID":"4b7bcdde-0f52-4068-8af9-12b8a530d2c7","Type":"ContainerDied","Data":"814f0c1dd07be46e26e32f59e6e9c8d89c188aee420b11f41a85d7fd9e1fc587"} Jul 06 14:23:42.233203 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.233182 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:23:42.323883 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323796 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.323883 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323869 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.323883 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323893 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.324152 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.324152 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323939 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.324152 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.323964 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mbbs\" (UniqueName: \"kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs\") pod \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\" (UID: \"4b7bcdde-0f52-4068-8af9-12b8a530d2c7\") " Jul 06 14:23:42.324152 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324087 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:42.324359 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324164 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home" (OuterVolumeSpecName: "home") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:42.324359 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324172 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:42.324359 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324286 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-model-cache\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:42.324359 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324305 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-home\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:42.324359 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.324319 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tmp-dir\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:42.326071 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.326048 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm" (OuterVolumeSpecName: "dshm") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:42.326153 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.326119 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs" (OuterVolumeSpecName: "kube-api-access-2mbbs") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "kube-api-access-2mbbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:23:42.326192 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.326178 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b7bcdde-0f52-4068-8af9-12b8a530d2c7" (UID: "4b7bcdde-0f52-4068-8af9-12b8a530d2c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:23:42.425156 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.425131 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-dshm\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:42.425156 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.425153 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-tls-certs\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:42.425316 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:42.425163 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mbbs\" (UniqueName: \"kubernetes.io/projected/4b7bcdde-0f52-4068-8af9-12b8a530d2c7-kube-api-access-2mbbs\") on node \"ip-10-0-143-72.ec2.internal\" DevicePath \"\"" Jul 06 14:23:43.225645 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.225615 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" Jul 06 14:23:43.226071 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.225613 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt" event={"ID":"4b7bcdde-0f52-4068-8af9-12b8a530d2c7","Type":"ContainerDied","Data":"f2cb85640e910eef1f183e600339ea0ee892b485888e12b146aa35be72840d35"} Jul 06 14:23:43.226071 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.225734 2581 scope.go:117] "RemoveContainer" containerID="814f0c1dd07be46e26e32f59e6e9c8d89c188aee420b11f41a85d7fd9e1fc587" Jul 06 14:23:43.249802 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.249778 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:23:43.258145 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.258125 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0ba2b8/rate-test-model-0ba2b8-kserve-57fcc46fff-trbmt"] Jul 06 14:23:43.511306 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:23:43.511213 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" path="/var/lib/kubelet/pods/4b7bcdde-0f52-4068-8af9-12b8a530d2c7/volumes" Jul 06 14:24:15.576440 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:15.576407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h72pr"] Jul 06 14:24:25.324333 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:25.324304 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-g85b5_81852daf-1c10-4fe8-9483-8d99e92234b3/copy-manifests/0.log" Jul 06 14:24:25.336537 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:25.336513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-g85b5_81852daf-1c10-4fe8-9483-8d99e92234b3/manager/0.log" Jul 06 14:24:27.908435 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:27.908399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h72pr_40307d11-cbc4-4e7c-b06e-a9c0b77a0cac/limitador/0.log" Jul 06 14:24:28.534683 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:28.534648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-675xf_eec493e4-1d45-4ac1-85ba-b479d97f7334/discovery/0.log" Jul 06 14:24:29.906592 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:29.906565 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6tgcg_9b428971-001f-4737-860e-9cee3f0c5d04/main/0.log" Jul 06 14:24:30.145201 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:30.145172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4vxxg_9931bdc4-2312-4353-9df3-a30e13df7916/main/0.log" Jul 06 14:24:37.237805 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:37.237779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b55qd_24db6f37-127d-422b-998e-4ccdb84cddf0/global-pull-secret-syncer/0.log" Jul 06 14:24:37.448493 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:37.448464 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wz2mq_e00b37a9-c40b-4d87-88b7-b04be656a163/konnectivity-agent/0.log" Jul 06 14:24:37.535979 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:37.535946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-72.ec2.internal_27db7d2e29939ec76943127ff4b64abe/haproxy/0.log" Jul 06 14:24:43.008892 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:43.008866 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h72pr_40307d11-cbc4-4e7c-b06e-a9c0b77a0cac/limitador/0.log" Jul 06 14:24:45.352654 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:45.352619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpwcl_c583762f-9cf8-4c32-93a2-1c4f82f4fdf4/node-exporter/0.log" Jul 06 14:24:45.377920 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:45.377900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpwcl_c583762f-9cf8-4c32-93a2-1c4f82f4fdf4/kube-rbac-proxy/0.log" Jul 06 14:24:45.401322 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:45.401300 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpwcl_c583762f-9cf8-4c32-93a2-1c4f82f4fdf4/init-textfile/0.log" Jul 06 14:24:47.197080 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.197048 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp"] Jul 06 14:24:47.197526 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.197352 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" containerName="main" Jul 06 14:24:47.197526 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.197364 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" containerName="main" Jul 06 14:24:47.197526 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.197413 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b7bcdde-0f52-4068-8af9-12b8a530d2c7" containerName="main" Jul 06 14:24:47.200260 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.200220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.204321 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.204298 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7nz7d\"/\"default-dockercfg-hxwfj\"" Jul 06 14:24:47.204462 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.204331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"openshift-service-ca.crt\"" Jul 06 14:24:47.204462 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.204402 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"kube-root-ca.crt\"" Jul 06 14:24:47.208724 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.208698 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp"] Jul 06 14:24:47.315286 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.315255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-lib-modules\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.315457 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.315291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-proc\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.315457 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.315312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-podres\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.315457 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.315332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-sys\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.315597 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.315465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpz2\" (UniqueName: \"kubernetes.io/projected/50f3ed1c-7be6-4c67-9eaf-5370c079be66-kube-api-access-9fpz2\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416586 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpz2\" (UniqueName: \"kubernetes.io/projected/50f3ed1c-7be6-4c67-9eaf-5370c079be66-kube-api-access-9fpz2\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416755 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-lib-modules\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416755 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-proc\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416755 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-podres\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416755 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-sys\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416913 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416748 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-proc\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416913 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-sys\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416913 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416796 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-lib-modules\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.416913 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.416811 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50f3ed1c-7be6-4c67-9eaf-5370c079be66-podres\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.425441 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.425421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpz2\" (UniqueName: \"kubernetes.io/projected/50f3ed1c-7be6-4c67-9eaf-5370c079be66-kube-api-access-9fpz2\") pod \"perf-node-gather-daemonset-5xqbp\" (UID: \"50f3ed1c-7be6-4c67-9eaf-5370c079be66\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.511240 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.511169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:47.633058 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:47.633033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp"] Jul 06 14:24:47.635500 ip-10-0-143-72 kubenswrapper[2581]: W0706 14:24:47.635471 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50f3ed1c_7be6_4c67_9eaf_5370c079be66.slice/crio-0e2bb08c27dee3868dbea7e8e99e3c029502f26884493fdcfa546a3606f14554 WatchSource:0}: Error finding container 0e2bb08c27dee3868dbea7e8e99e3c029502f26884493fdcfa546a3606f14554: Status 404 returned error can't find the container with id 0e2bb08c27dee3868dbea7e8e99e3c029502f26884493fdcfa546a3606f14554 Jul 06 14:24:48.482497 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:48.482462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" event={"ID":"50f3ed1c-7be6-4c67-9eaf-5370c079be66","Type":"ContainerStarted","Data":"ddf455d729777436b379c532356cc31c8e51eb5f091b4a62092ef2a836cdfb0b"} Jul 06 14:24:48.482949 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:48.482514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" event={"ID":"50f3ed1c-7be6-4c67-9eaf-5370c079be66","Type":"ContainerStarted","Data":"0e2bb08c27dee3868dbea7e8e99e3c029502f26884493fdcfa546a3606f14554"} Jul 06 14:24:48.482949 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:48.482569 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:48.498729 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:48.498682 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" podStartSLOduration=1.49866865 podStartE2EDuration="1.49866865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:48.498120463 +0000 UTC m=+2391.467708707" watchObservedRunningTime="2026-07-06 14:24:48.49866865 +0000 UTC m=+2391.468256893" Jul 06 14:24:50.189752 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:50.189724 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zxc8_47248937-8d13-4787-ba1e-8a489d308ace/dns/0.log" Jul 06 14:24:50.214426 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:50.214405 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zxc8_47248937-8d13-4787-ba1e-8a489d308ace/kube-rbac-proxy/0.log" Jul 06 14:24:50.330722 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:50.330693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-flg4b_4480b57a-fc82-49f4-bd1d-ad9427276563/dns-node-resolver/0.log" Jul 06 14:24:50.957857 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:50.957825 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6c8rn_634fbe62-1314-41b6-ace5-c4d9bd60a4f4/node-ca/0.log" Jul 06 14:24:52.095726 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:52.095691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-675xf_eec493e4-1d45-4ac1-85ba-b479d97f7334/discovery/0.log" Jul 06 14:24:53.100386 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:53.100354 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n55w5_51b7fd1a-937a-41dc-ad31-5eefc2dcd55c/serve-healthcheck-canary/0.log" Jul 06 14:24:53.774107 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:53.774078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzj7k_e44850ce-82e8-47ad-be3a-95c1b2c49e47/kube-rbac-proxy/0.log" Jul 06 14:24:53.798660 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:53.798635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzj7k_e44850ce-82e8-47ad-be3a-95c1b2c49e47/exporter/0.log" Jul 06 14:24:53.823189 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:53.823161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzj7k_e44850ce-82e8-47ad-be3a-95c1b2c49e47/extractor/0.log" Jul 06 14:24:54.495040 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:54.495010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-5xqbp" Jul 06 14:24:56.823803 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:56.823774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-g85b5_81852daf-1c10-4fe8-9483-8d99e92234b3/manager/0.log" Jul 06 14:24:56.843903 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:56.843881 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-g85b5_81852daf-1c10-4fe8-9483-8d99e92234b3/copy-manifests/0.log" Jul 06 14:24:57.685136 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:57.685111 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-675xf_eec493e4-1d45-4ac1-85ba-b479d97f7334/discovery/0.log" Jul 06 14:24:58.354931 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:58.354905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-665d757866-f2c46_a77b3f43-ca82-4e4f-a409-8b0705a3cf89/manager/0.log" Jul 06 14:24:58.384083 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:58.384064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sw449_0e1545d0-c732-4de7-b3f2-99b7117c744b/openshift-lws-operator/0.log" Jul 06 14:24:59.154441 ip-10-0-143-72 kubenswrapper[2581]: I0706 14:24:59.154414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-675xf_eec493e4-1d45-4ac1-85ba-b479d97f7334/discovery/0.log"