Sep 07 03:55:48.798135 ip-10-0-143-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 03:55:48.798144 ip-10-0-143-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 03:55:48.798152 ip-10-0-143-54 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 03:55:48.798314 ip-10-0-143-54 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 03:55:59.025313 ip-10-0-143-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 03:55:59.025328 ip-10-0-143-54 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c9b24ebd530f484a9c0e9bec23ac3691 -- Sep 07 03:57:32.233984 ip-10-0-143-54 systemd[1]: Starting Kubernetes Kubelet... Sep 07 03:57:32.648689 ip-10-0-143-54 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:32.648689 ip-10-0-143-54 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 03:57:32.648689 ip-10-0-143-54 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:32.648689 ip-10-0-143-54 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 03:57:32.648689 ip-10-0-143-54 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:32.650386 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.650300 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 03:57:32.657849 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657830 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.657849 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657846 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.657849 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657850 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.657849 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657853 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.657849 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657857 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657861 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657864 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657867 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657871 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657874 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657877 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657880 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657883 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657885 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657888 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657891 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657895 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657898 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657901 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657903 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657906 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657909 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657912 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.658028 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657915 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657919 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657923 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657927 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657930 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657933 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657935 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657938 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657940 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657943 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657946 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657949 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657951 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657954 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657957 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657961 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657964 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657967 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657970 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.658566 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657973 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657976 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657979 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657982 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657984 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657987 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657990 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657993 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657995 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.657998 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658000 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658003 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658006 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658008 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658011 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658014 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658016 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658019 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658022 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.659094 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658025 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658029 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658033 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658036 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658039 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658042 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658046 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658048 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658051 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658055 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658059 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658061 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658064 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658067 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658069 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658072 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658075 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658078 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658080 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.659551 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658083 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658085 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658088 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658091 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658093 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658096 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658099 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658101 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658105 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658109 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658112 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658114 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658118 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658120 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658123 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658126 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658128 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658131 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658133 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658874 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.660046 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658882 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658884 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658889 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658893 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658896 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658899 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658902 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658905 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658907 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658910 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658912 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658916 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658919 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658922 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658924 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658927 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658930 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658932 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658935 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658937 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.660533 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658941 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658945 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658949 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658952 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658955 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658957 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658960 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658963 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658966 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658970 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658973 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658979 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658981 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658985 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658987 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658990 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658993 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658996 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.661058 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.658999 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659001 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659004 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659007 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659017 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659020 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659023 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659026 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659029 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659032 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659034 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659037 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659040 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659042 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659045 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659048 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659050 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659053 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659055 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.661523 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659058 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659061 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659063 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659066 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659068 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659071 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659073 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659076 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659079 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659082 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659084 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659087 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659091 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659093 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659096 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659099 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659102 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659104 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659107 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.662013 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659110 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659113 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659115 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659118 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659120 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659123 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659125 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659129 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659132 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659135 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659137 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659140 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659143 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659145 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659148 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659150 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659153 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659156 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659159 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659161 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.662491 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659164 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659568 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659573 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659577 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659580 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659587 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659591 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659595 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659597 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659600 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659603 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659606 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659609 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659612 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659615 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659617 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659620 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659632 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659635 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659637 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.663019 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659640 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659643 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659646 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659648 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659651 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659654 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659656 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659659 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659662 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659664 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659667 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659684 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659688 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659697 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659700 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659702 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659705 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659708 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659718 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659721 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.663503 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659723 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659726 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659728 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659731 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659736 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659739 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659743 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659747 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659750 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659753 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659756 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659759 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659762 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659765 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659768 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659770 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659773 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659775 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659778 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.664077 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659781 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659783 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659786 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659789 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659791 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659794 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659800 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659803 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659806 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659808 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659811 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659813 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659816 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659819 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659822 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659825 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659827 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659830 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659832 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659835 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.664549 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659838 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659840 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659843 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659846 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659848 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659851 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659854 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659856 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659859 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659862 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659865 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659867 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659870 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659873 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659875 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659878 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659881 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659883 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659887 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.665047 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659890 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.659892 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.659974 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660007 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660014 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660019 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660024 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660028 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660033 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660042 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660045 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660048 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660052 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660055 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660059 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660062 2579 flags.go:64] FLAG: --cgroup-root="" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660065 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660068 2579 flags.go:64] FLAG: --client-ca-file="" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660071 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660074 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660079 2579 flags.go:64] FLAG: --cluster-domain="" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660082 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660086 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660089 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 03:57:32.665535 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660092 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660097 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660100 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660103 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660107 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660110 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660113 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660118 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660121 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660124 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660128 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660132 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660135 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660141 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660144 2579 flags.go:64] FLAG: --enable-server="true" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660148 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660152 2579 flags.go:64] FLAG: --event-burst="100" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660155 2579 flags.go:64] FLAG: --event-qps="50" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660158 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660162 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660165 2579 flags.go:64] FLAG: --eviction-hard="" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660168 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660171 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660174 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660177 2579 flags.go:64] FLAG: --eviction-soft="" Sep 07 03:57:32.666131 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660180 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660183 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660187 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660189 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660192 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660195 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660198 2579 flags.go:64] FLAG: --feature-gates="" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660201 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660205 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660208 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660211 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660214 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660217 2579 flags.go:64] FLAG: --help="false" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660220 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-54.ec2.internal" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660225 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660228 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660231 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660234 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660237 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660240 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660244 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660247 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660250 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 03:57:32.666747 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660254 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660257 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660260 2579 flags.go:64] FLAG: --kube-reserved="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660263 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660266 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660269 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660272 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660275 2579 flags.go:64] FLAG: --lock-file="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660278 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660281 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660284 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660289 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660292 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660295 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660298 2579 flags.go:64] FLAG: --logging-format="text" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660301 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660305 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660308 2579 flags.go:64] FLAG: --manifest-url="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660311 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660315 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660318 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660322 2579 flags.go:64] FLAG: --max-pods="110" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660325 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660329 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660332 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 03:57:32.667350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660336 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660339 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660342 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660345 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660355 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660358 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660361 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660364 2579 flags.go:64] FLAG: --pod-cidr="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660368 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660373 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660376 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660379 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660382 2579 flags.go:64] FLAG: --port="10250" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660385 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660388 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b752737de9888414" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660391 2579 flags.go:64] FLAG: --qos-reserved="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660394 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660397 2579 flags.go:64] FLAG: --register-node="true" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660400 2579 flags.go:64] FLAG: --register-with-taints="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660404 2579 flags.go:64] FLAG: --registry-burst="10" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660407 2579 flags.go:64] FLAG: --registry-qps="5" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660410 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660413 2579 flags.go:64] FLAG: --reserved-memory="" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660417 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660420 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 03:57:32.667990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660423 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660427 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660429 2579 flags.go:64] FLAG: --runonce="false" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660432 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660435 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660438 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660444 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660447 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660450 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660453 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660457 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660461 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660464 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660467 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660470 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660473 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660477 2579 flags.go:64] FLAG: --system-cgroups="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660480 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660486 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660489 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660492 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660496 2579 flags.go:64] FLAG: --tls-min-version="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660516 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660521 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660524 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 03:57:32.668636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660527 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660531 2579 flags.go:64] FLAG: --v="2" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660535 2579 flags.go:64] FLAG: --version="false" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660539 2579 flags.go:64] FLAG: --vmodule="" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660543 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.660546 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660689 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660694 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660697 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660700 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660703 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660706 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660709 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660712 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660715 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660718 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660721 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660723 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660727 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660730 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660732 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.669302 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660735 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660737 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660740 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660743 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660746 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660749 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660751 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660754 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660757 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660759 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660762 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660764 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660767 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660770 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660772 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660775 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660777 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660780 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660783 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.669848 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660785 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660789 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660793 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660796 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660799 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660803 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660806 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660809 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660811 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660814 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660818 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660820 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660823 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660826 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660829 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660832 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660835 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660838 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660841 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660843 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.670319 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660846 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660849 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660851 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660854 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660857 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660859 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660862 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660864 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660867 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660869 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660872 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660875 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660877 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660880 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660882 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660885 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660887 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660891 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660895 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.670834 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660898 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660901 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660904 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660907 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660910 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660912 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660915 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660918 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660920 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660923 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660926 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660929 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660931 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660934 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660937 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660939 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660942 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660944 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660950 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.671289 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660954 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660956 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660959 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660962 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660964 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.660967 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.662365 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.669788 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.669803 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.669822 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.669829 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669888 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669894 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669897 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669900 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.671804 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669904 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669907 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669910 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669913 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669916 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669919 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669921 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669924 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669928 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669930 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669934 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669936 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669939 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669942 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669945 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669948 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669950 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669954 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669958 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669961 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.672182 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669963 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669966 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669969 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669973 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669976 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669981 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669984 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669987 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669990 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669992 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669995 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.669998 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670001 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670003 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670006 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670008 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670011 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670013 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670016 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.672681 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670019 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670021 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670024 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670027 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670029 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670033 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670035 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670038 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670041 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670043 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670046 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670048 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670051 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670054 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670056 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670059 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670061 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670064 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670067 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670070 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.673158 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670073 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670076 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670078 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670081 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670084 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670086 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670089 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670091 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670094 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670096 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670099 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670102 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670106 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670109 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670112 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670115 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670118 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670121 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670124 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.673632 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670126 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670129 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670131 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670134 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670136 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670139 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670141 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670144 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670147 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670149 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670152 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670155 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670157 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670160 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670163 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670165 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.674120 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670168 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.670173 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670289 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670294 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670298 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670301 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670303 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670306 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670308 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670311 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670314 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670317 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670319 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670322 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670325 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:32.674510 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670328 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670331 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670334 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670336 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670339 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670342 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670344 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670347 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670349 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670352 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670355 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670357 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670360 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670363 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670365 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670372 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670374 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670377 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670380 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670382 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:32.674958 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670385 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670388 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670390 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670392 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670395 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670397 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670400 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670403 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670405 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670408 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670410 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670413 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670415 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670418 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670421 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670424 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670426 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670429 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670431 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670434 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:32.675473 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670436 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670439 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670441 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670445 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670449 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670453 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670456 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670459 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670462 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670467 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670470 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670472 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670476 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670480 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670483 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670485 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670488 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670490 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:32.675985 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670493 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670496 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670498 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670501 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670503 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670506 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670509 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670511 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670514 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670517 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670519 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670522 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670524 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670527 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670529 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670532 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670534 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670537 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670539 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:32.676438 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670543 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670547 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670550 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670553 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670556 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670559 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670562 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:32.670564 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.670570 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.670688 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.673076 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.674008 2579 server.go:1019] "Starting client certificate rotation" Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.674100 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 03:57:32.676923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.674132 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 03:57:32.677258 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.676848 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 03:57:32.681619 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.681591 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 03:57:32.693199 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.693178 2579 log.go:25] "Validated CRI v1 runtime API" Sep 07 03:57:32.698068 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.698053 2579 log.go:25] "Validated CRI v1 image API" Sep 07 03:57:32.698846 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.698826 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 03:57:32.701447 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.701420 2579 fs.go:135] Filesystem UUIDs: map[332ae3ff-6315-4647-b09a-aa550eb23529:/dev/nvme0n1p3 77784f47-749c-4ea7-b45d-6e148413d8a8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 07 03:57:32.701509 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.701447 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 03:57:32.706860 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.706726 2579 manager.go:216] Machine: {Timestamp:2026-09-07 03:57:32.705273667 +0000 UTC m=+0.360842201 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100076 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23cceb9675008b8eec5dfabbd9d7df SystemUUID:ec23cceb-9675-008b-8eec-5dfabbd9d7df BootID:c9b24ebd-530f-484a-9c0e-9bec23ac3691 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:83:03:53:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:83:03:53:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:3c:30:b3:69:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 03:57:32.706860 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.706856 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 03:57:32.706982 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.706971 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 03:57:32.710707 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.710684 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 03:57:32.710853 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.710711 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 03:57:32.712136 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.712124 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 03:57:32.712172 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.712139 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 03:57:32.712172 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.712147 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 03:57:32.712940 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.712927 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 03:57:32.714606 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.714591 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 03:57:32.714819 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.714808 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 03:57:32.719298 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719286 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 03:57:32.719423 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719414 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 03:57:32.719458 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719443 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 07 03:57:32.719458 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719453 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 03:57:32.719509 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719467 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 03:57:32.719509 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719478 2579 kubelet.go:398] "Adding apiserver pod source" Sep 07 03:57:32.719509 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719486 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 03:57:32.719877 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719864 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 03:57:32.719915 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.719893 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 03:57:32.722416 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.722399 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 03:57:32.725631 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725618 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 03:57:32.725680 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725648 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 03:57:32.725831 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725818 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 03:57:32.725871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725838 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 03:57:32.725871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725844 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 03:57:32.725871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725850 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 03:57:32.725871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725858 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 03:57:32.725871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.725864 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 03:57:32.726569 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726559 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 03:57:32.726598 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726570 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 03:57:32.726598 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726577 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 03:57:32.726598 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726582 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 03:57:32.726598 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726591 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 03:57:32.726598 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.726598 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 03:57:32.728330 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.728316 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 03:57:32.728364 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.728332 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 03:57:32.732615 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.732592 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 03:57:32.732737 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.732618 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 03:57:32.732827 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.732807 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 03:57:32.733179 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.733162 2579 server.go:1268] "Started kubelet" Sep 07 03:57:32.733277 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.733246 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 03:57:32.733320 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.733253 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 03:57:32.733357 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.733321 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 03:57:32.734054 ip-10-0-143-54 systemd[1]: Started Kubernetes Kubelet. Sep 07 03:57:32.735433 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.735416 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 03:57:32.736842 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.736829 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 07 03:57:32.738460 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.738442 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 03:57:32.741747 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.740612 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18d2edc9bce94eea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-09-07 03:57:32.73312433 +0000 UTC m=+0.388692866,LastTimestamp:2026-09-07 03:57:32.73312433 +0000 UTC m=+0.388692866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}" Sep 07 03:57:32.742949 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.742933 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 03:57:32.743012 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.742948 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 03:57:32.743062 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.743017 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:32.743713 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743696 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 03:57:32.743713 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743709 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 03:57:32.743835 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743715 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 03:57:32.743877 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743858 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 07 03:57:32.743877 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743868 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 07 03:57:32.743952 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743923 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 03:57:32.743952 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743940 2579 factory.go:55] Registering systemd factory Sep 07 03:57:32.743952 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.743950 2579 factory.go:223] Registration of the systemd container factory successfully Sep 07 03:57:32.744252 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.744236 2579 factory.go:153] Registering CRI-O factory Sep 07 03:57:32.744252 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.744251 2579 factory.go:223] Registration of the crio container factory successfully Sep 07 03:57:32.744377 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.744269 2579 factory.go:103] Registering Raw factory Sep 07 03:57:32.744377 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.744281 2579 manager.go:1196] Started watching for new ooms in manager Sep 07 03:57:32.744624 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.744613 2579 manager.go:349] Starting recovery of all containers Sep 07 03:57:32.747282 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.747251 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 03:57:32.747423 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.747398 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 03:57:32.753592 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.753568 2579 manager.go:354] Recovery completed Sep 07 03:57:32.760987 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.760971 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.763958 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.763935 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.764028 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.763969 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.764028 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.763980 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.764550 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.764537 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 03:57:32.764550 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.764548 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 03:57:32.764626 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.764556 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.764626 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.764563 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 03:57:32.765974 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.765950 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9fljk" Sep 07 03:57:32.766181 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766158 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.766273 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766195 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.766273 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766205 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.766273 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.766168 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18d2edc9bebfcac6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-54.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-09-07 03:57:32.763957958 +0000 UTC m=+0.419526491,LastTimestamp:2026-09-07 03:57:32.763957958 +0000 UTC m=+0.419526491,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}" Sep 07 03:57:32.766813 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766792 2579 policy_none.go:49] "None policy: Start" Sep 07 03:57:32.766813 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766813 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 03:57:32.766931 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.766827 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 03:57:32.768741 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.768729 2579 policy_none.go:47] "Start" Sep 07 03:57:32.775072 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.775054 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9fljk" Sep 07 03:57:32.775644 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.775575 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18d2edc9bec00c36 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-54.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-09-07 03:57:32.76397471 +0000 UTC m=+0.419543243,LastTimestamp:2026-09-07 03:57:32.76397471 +0000 UTC m=+0.419543243,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}" Sep 07 03:57:32.843575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.843539 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:32.850250 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.850204 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 03:57:32.851466 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.851442 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 03:57:32.851556 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.851508 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 03:57:32.851556 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.851539 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 03:57:32.851849 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.851647 2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 07 03:57:32.853611 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.853589 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:32.944463 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.944438 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:32.945808 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.945796 2579 manager.go:337] "Starting Device Plugin manager" Sep 07 03:57:32.945873 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.945835 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 03:57:32.945873 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.945844 2579 server.go:87] "Starting device plugin registration server" Sep 07 03:57:32.946148 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.946136 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 03:57:32.946204 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.946150 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 03:57:32.946265 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.946244 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 03:57:32.946345 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.946331 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 03:57:32.946395 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.946347 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 03:57:32.946950 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.946931 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 03:57:32.947035 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.946981 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:32.952166 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.952150 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"] Sep 07 03:57:32.952244 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.952225 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.953387 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.953371 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-54.ec2.internal\" not found" node="ip-10-0-143-54.ec2.internal" Sep 07 03:57:32.953766 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.953750 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.953817 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.953781 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.953817 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.953792 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.955924 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.955910 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.956039 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.956027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:32.956085 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.956053 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.956652 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.956639 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.956727 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.956697 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.956727 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.956708 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.957186 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.957170 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.957257 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.957200 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.957257 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.957214 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.959246 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.959231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:32.959378 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.959261 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:32.959926 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.959908 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:32.960018 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.959935 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:32.960018 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:32.959947 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:32.982257 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.982236 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-54.ec2.internal\" not found" node="ip-10-0-143-54.ec2.internal" Sep 07 03:57:32.986682 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:32.986653 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-54.ec2.internal\" not found" node="ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.045135 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.045100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.045135 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.045135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.045296 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.045156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8abc5811eae218b508d7d4b044d4dc6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"c8abc5811eae218b508d7d4b044d4dc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.047214 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.047199 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:33.048191 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.048176 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:33.048260 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.048203 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:33.048260 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.048213 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:33.048260 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.048238 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.057489 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.057473 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.057556 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.057497 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-54.ec2.internal\": node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.084919 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.084900 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.146284 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.146391 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.146391 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.146391 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8abc5811eae218b508d7d4b044d4dc6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"c8abc5811eae218b508d7d4b044d4dc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.146391 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327991e56010d9bc65c5501f742e0222-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"327991e56010d9bc65c5501f742e0222\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.146512 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.146393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8abc5811eae218b508d7d4b044d4dc6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"c8abc5811eae218b508d7d4b044d4dc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.185554 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.185471 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.285135 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.285096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.286183 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.286168 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.289966 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.289952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:33.387157 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.387119 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.488171 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.488079 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.589289 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.589255 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.673473 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.673435 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 03:57:33.674151 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.673601 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 03:57:33.689907 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.689868 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.778089 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.778010 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 03:52:32 +0000 UTC" deadline="2028-03-31 23:05:17.691044494 +0000 UTC" Sep 07 03:57:33.778089 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.778044 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13723h7m43.913004245s" Sep 07 03:57:33.790261 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.790236 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.830459 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.830419 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:33.831520 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.831499 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:33.831613 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.831534 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:33.831613 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.831545 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:33.885788 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:33.885761 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8abc5811eae218b508d7d4b044d4dc6.slice/crio-1cfb2fc51c4250352f8cabce929661d9a2371068b6aef1af45f045f43c7c1958 WatchSource:0}: Error finding container 1cfb2fc51c4250352f8cabce929661d9a2371068b6aef1af45f045f43c7c1958: Status 404 returned error can't find the container with id 1cfb2fc51c4250352f8cabce929661d9a2371068b6aef1af45f045f43c7c1958 Sep 07 03:57:33.887363 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:33.887338 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327991e56010d9bc65c5501f742e0222.slice/crio-f172fc67a590aaccd77768ac9034eb3a3067a613910c02a05deef7aae676578b WatchSource:0}: Error finding container f172fc67a590aaccd77768ac9034eb3a3067a613910c02a05deef7aae676578b: Status 404 returned error can't find the container with id f172fc67a590aaccd77768ac9034eb3a3067a613910c02a05deef7aae676578b Sep 07 03:57:33.890629 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.890608 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:33.893171 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:33.893156 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 03:57:33.993083 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:33.993034 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:34.093649 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.093574 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found" Sep 07 03:57:34.193532 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.193489 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:34.243998 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.243946 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" Sep 07 03:57:34.246547 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.246521 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:34.258342 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.258320 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 03:57:34.260046 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.260030 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" Sep 07 03:57:34.268708 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.268670 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 03:57:34.337460 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.337423 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:34.720777 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.720744 2579 apiserver.go:52] "Watching apiserver" Sep 07 03:57:34.727448 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.727417 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 03:57:34.730225 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.729587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q7bxz","kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx","openshift-dns/node-resolver-5rz6f","openshift-image-registry/node-ca-dfz9w","openshift-multus/multus-additional-cni-plugins-zz99m","openshift-network-operator/iptables-alerter-m4hxb","kube-system/konnectivity-agent-xmhtt","openshift-cluster-node-tuning-operator/tuned-8j7x2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal","openshift-multus/multus-ccfcr","openshift-multus/network-metrics-daemon-6hr6m","openshift-network-diagnostics/network-check-target-62s55","openshift-ovn-kubernetes/ovnkube-node-gq5p9"] Sep 07 03:57:34.732386 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.732363 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.734692 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.734572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:34.734692 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.734647 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:34.735203 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.735184 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.735283 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.735263 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.735331 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.735290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5hwcm\"" Sep 07 03:57:34.735464 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.735448 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 03:57:34.736800 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.736778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.738969 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.738948 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.739065 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.739030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.739461 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.739364 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 03:57:34.739461 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.739368 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.739739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.739721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5hz8\"" Sep 07 03:57:34.741143 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.741125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.741730 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.741330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.741730 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.741548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t7wm7\"" Sep 07 03:57:34.741876 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.741859 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.743504 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.743484 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 03:57:34.743840 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.743820 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.743968 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.743950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.744020 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.743823 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b2cd4\"" Sep 07 03:57:34.744316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.744292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 03:57:34.744599 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.744575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.746818 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.746757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.747191 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.747167 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 03:57:34.747294 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.747274 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.747405 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.747388 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 03:57:34.747542 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.747525 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 03:57:34.747605 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.747586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r92bp\"" Sep 07 03:57:34.748601 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.748565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.750035 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.749740 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.750035 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.749794 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.750035 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.749806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.750035 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.749897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:34.750554 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.750535 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jf8qv\"" Sep 07 03:57:34.752573 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.752266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.755112 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.754726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.755375 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.755353 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 03:57:34.755640 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.755621 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9ppct\"" Sep 07 03:57:34.755736 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.755683 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 03:57:34.755807 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.755625 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 03:57:34.755881 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.755866 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 03:57:34.756035 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.756020 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 03:57:34.756097 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.756021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 03:57:34.756097 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.756067 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 03:57:34.757238 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757217 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 03:57:34.757322 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757290 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 03:57:34.757407 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205d4303-a34a-4794-a22b-1299d028f459-host-slash\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.757471 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:34.757471 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757225 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qh246\"" Sep 07 03:57:34.757471 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjppj\" (UniqueName: \"kubernetes.io/projected/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kube-api-access-bjppj\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.757471 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ebfbf69-5462-4af2-aedf-01685306f527-hosts-file\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.757704 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfbf69-5462-4af2-aedf-01685306f527-tmp-dir\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.757704 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-serviceca\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.757704 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df8dj\" (UniqueName: \"kubernetes.io/projected/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-kube-api-access-df8dj\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.757704 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62htv\" (UniqueName: \"kubernetes.io/projected/60125676-ef69-4ee5-8463-ff00c7735c9a-kube-api-access-62htv\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.757704 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-device-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-etc-selinux\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzz7r\" (UniqueName: \"kubernetes.io/projected/6ebfbf69-5462-4af2-aedf-01685306f527-kube-api-access-tzz7r\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-system-cni-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7xp\" (UniqueName: \"kubernetes.io/projected/205d4303-a34a-4794-a22b-1299d028f459-kube-api-access-xb7xp\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-socket-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.757955 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-registration-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-host\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.757992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-cnibin\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/205d4303-a34a-4794-a22b-1299d028f459-iptables-alerter-script\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-sys-fs\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.758316 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.758256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.759537 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.759520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:34.759609 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.759582 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:34.760685 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.760511 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 03:57:34.760685 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.760604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ctk5z\"" Sep 07 03:57:34.776964 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.776940 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-slhpl" Sep 07 03:57:34.784630 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.784595 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-slhpl" Sep 07 03:57:34.835544 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.835518 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:34.848008 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.847513 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 03:57:34.855686 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.855625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"327991e56010d9bc65c5501f742e0222","Type":"ContainerStarted","Data":"f172fc67a590aaccd77768ac9034eb3a3067a613910c02a05deef7aae676578b"} Sep 07 03:57:34.856616 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.856599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" event={"ID":"c8abc5811eae218b508d7d4b044d4dc6","Type":"ContainerStarted","Data":"1cfb2fc51c4250352f8cabce929661d9a2371068b6aef1af45f045f43c7c1958"} Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzz7r\" (UniqueName: \"kubernetes.io/projected/6ebfbf69-5462-4af2-aedf-01685306f527-kube-api-access-tzz7r\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-netd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-tmp\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7xp\" (UniqueName: \"kubernetes.io/projected/205d4303-a34a-4794-a22b-1299d028f459-kube-api-access-xb7xp\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.858996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-registration-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-systemd-units\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69a199ad-8452-4357-9503-6a6c916f32f3-agent-certs\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-multus\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-conf-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-cnibin\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.861092 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ebfbf69-5462-4af2-aedf-01685306f527-hosts-file\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-var-lib-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-etc-kubernetes\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysconfig\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-sys\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-multus-certs\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-run\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8br\" (UniqueName: \"kubernetes.io/projected/beda21c4-e267-4bb3-b5a2-0cdb437c557e-kube-api-access-9w8br\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-conf\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-netns\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-ovn\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-script-lib\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-socket-dir-parent\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-daemon-config\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84jc\" (UniqueName: \"kubernetes.io/projected/58775b98-3ad6-4949-8eea-804ce2783a3f-kube-api-access-j84jc\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:34.861990 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-systemd\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-log-socket\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cni-binary-copy\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-tuned\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-kubelet-config\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjppj\" (UniqueName: \"kubernetes.io/projected/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kube-api-access-bjppj\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfbf69-5462-4af2-aedf-01685306f527-tmp-dir\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-systemd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-bin\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-config\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-netns\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-kubernetes\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-serviceca\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62htv\" (UniqueName: \"kubernetes.io/projected/60125676-ef69-4ee5-8463-ff00c7735c9a-kube-api-access-62htv\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxjh\" (UniqueName: \"kubernetes.io/projected/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-kube-api-access-lhxjh\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.862662 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69a199ad-8452-4357-9503-6a6c916f32f3-konnectivity-ca\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.859989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-modprobe-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-var-lib-kubelet\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-host\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-env-overrides\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lmtd\" (UniqueName: \"kubernetes.io/projected/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-kube-api-access-7lmtd\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-lib-modules\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovn-node-metrics-cert\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-device-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-slash\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-etc-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cnibin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-k8s-cni-cncf-io\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-system-cni-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.863515 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-socket-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-system-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-bin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-kubelet\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-hostroot\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/205d4303-a34a-4794-a22b-1299d028f459-iptables-alerter-script\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-sys-fs\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-node-log\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-dbus\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205d4303-a34a-4794-a22b-1299d028f459-host-slash\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-kubelet\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-host\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df8dj\" (UniqueName: \"kubernetes.io/projected/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-kube-api-access-df8dj\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-etc-selinux\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.860802 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-etc-selinux\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864130 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-cnibin\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-socket-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-registration-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-host\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861765 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/205d4303-a34a-4794-a22b-1299d028f459-iptables-alerter-script\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60125676-ef69-4ee5-8463-ff00c7735c9a-system-cni-dir\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-sys-fs\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/205d4303-a34a-4794-a22b-1299d028f459-host-slash\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-device-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.861941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862079 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ebfbf69-5462-4af2-aedf-01685306f527-tmp-dir\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ebfbf69-5462-4af2-aedf-01685306f527-hosts-file\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862373 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60125676-ef69-4ee5-8463-ff00c7735c9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.864656 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.862651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-serviceca\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.867483 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.867461 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 03:57:34.868131 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.867821 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:34.868131 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.867848 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:34.868131 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.867862 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:34.868131 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.867962 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:57:35.367922067 +0000 UTC m=+3.023490608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:34.870954 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.870930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzz7r\" (UniqueName: \"kubernetes.io/projected/6ebfbf69-5462-4af2-aedf-01685306f527-kube-api-access-tzz7r\") pod \"node-resolver-5rz6f\" (UID: \"6ebfbf69-5462-4af2-aedf-01685306f527\") " pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:34.871072 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.871051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7xp\" (UniqueName: \"kubernetes.io/projected/205d4303-a34a-4794-a22b-1299d028f459-kube-api-access-xb7xp\") pod \"iptables-alerter-m4hxb\" (UID: \"205d4303-a34a-4794-a22b-1299d028f459\") " pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:34.871431 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.871405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df8dj\" (UniqueName: \"kubernetes.io/projected/0ad8ec9f-35dd-4028-b350-43bfb07a7a88-kube-api-access-df8dj\") pod \"node-ca-dfz9w\" (UID: \"0ad8ec9f-35dd-4028-b350-43bfb07a7a88\") " pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:34.871571 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.871553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62htv\" (UniqueName: \"kubernetes.io/projected/60125676-ef69-4ee5-8463-ff00c7735c9a-kube-api-access-62htv\") pod \"multus-additional-cni-plugins-zz99m\" (UID: \"60125676-ef69-4ee5-8463-ff00c7735c9a\") " pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:34.871868 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.871852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjppj\" (UniqueName: \"kubernetes.io/projected/6fa873af-9b8e-4d7e-b201-5a940dcb9e93-kube-api-access-bjppj\") pod \"aws-ebs-csi-driver-node-97fzx\" (UID: \"6fa873af-9b8e-4d7e-b201-5a940dcb9e93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:34.961746 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-host\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-netd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-netd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961861 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-host\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.961927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-tmp\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-systemd-units\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961956 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.961993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69a199ad-8452-4357-9503-6a6c916f32f3-agent-certs\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-systemd-units\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-multus\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-multus\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-conf-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-var-lib-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-conf-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-etc-kubernetes\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-etc-kubernetes\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-var-lib-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysconfig\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-sys\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.962307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-multus-certs\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-run\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysconfig\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-sys\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8br\" (UniqueName: \"kubernetes.io/projected/beda21c4-e267-4bb3-b5a2-0cdb437c557e-kube-api-access-9w8br\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-multus-certs\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-conf\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-run\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-netns\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-ovn\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.962402 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-script-lib\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-socket-dir-parent\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-daemon-config\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-conf\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.962502 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:35.46248208 +0000 UTC m=+3.118050621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962523 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-ovn\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963127 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-netns\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962612 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-socket-dir-parent\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84jc\" (UniqueName: \"kubernetes.io/projected/58775b98-3ad6-4949-8eea-804ce2783a3f-kube-api-access-j84jc\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-systemd\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-log-socket\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cni-binary-copy\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-tuned\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-kubelet-config\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-systemd\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-systemd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-bin\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-config\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-netns\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-kubernetes\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxjh\" (UniqueName: \"kubernetes.io/projected/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-kube-api-access-lhxjh\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.962989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69a199ad-8452-4357-9503-6a6c916f32f3-konnectivity-ca\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-multus-daemon-config\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-run-systemd\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.963977 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-netns\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-modprobe-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-script-lib\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-cni-bin\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963182 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-log-socket\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-kubernetes\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-var-lib-kubelet\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-env-overrides\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lmtd\" (UniqueName: \"kubernetes.io/projected/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-kube-api-access-7lmtd\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-lib-modules\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovn-node-metrics-cert\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-slash\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-etc-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cnibin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-k8s-cni-cncf-io\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.964858 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-system-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69a199ad-8452-4357-9503-6a6c916f32f3-konnectivity-ca\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-bin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-kubelet\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-hostroot\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovnkube-config\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-node-log\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-dbus\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-slash\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-kubelet\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-var-lib-kubelet\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cni-binary-copy\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-kubelet-config\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-node-log\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963796 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-lib-modules\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-run-ovn-kubernetes\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-cnibin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-etc-openvswitch\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.965739 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963884 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-sysctl-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-modprobe-d\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87010d61-5656-4487-ab32-47577943ddf5-dbus\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-cni-bin\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-run-k8s-cni-cncf-io\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.963972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-hostroot\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.964022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-host-var-lib-kubelet\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.964061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-host-kubelet\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.964146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-system-cni-dir\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.964284 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.964396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-env-overrides\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:34.964412 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:57:35.464396025 +0000 UTC m=+3.119964559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.964975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69a199ad-8452-4357-9503-6a6c916f32f3-agent-certs\") pod \"konnectivity-agent-xmhtt\" (UID: \"69a199ad-8452-4357-9503-6a6c916f32f3\") " pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.966213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-etc-tuned\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.966440 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.966441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-ovn-node-metrics-cert\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.966927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.966612 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beda21c4-e267-4bb3-b5a2-0cdb437c557e-tmp\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.973950 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.973880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8br\" (UniqueName: \"kubernetes.io/projected/beda21c4-e267-4bb3-b5a2-0cdb437c557e-kube-api-access-9w8br\") pod \"tuned-8j7x2\" (UID: \"beda21c4-e267-4bb3-b5a2-0cdb437c557e\") " pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:34.974225 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.974186 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lmtd\" (UniqueName: \"kubernetes.io/projected/7bc9200f-e8a9-41ff-9d6a-8dbc98719864-kube-api-access-7lmtd\") pod \"multus-ccfcr\" (UID: \"7bc9200f-e8a9-41ff-9d6a-8dbc98719864\") " pod="openshift-multus/multus-ccfcr" Sep 07 03:57:34.974319 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.974298 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxjh\" (UniqueName: \"kubernetes.io/projected/6e6f28ae-470c-4e2b-aefc-3ee361ed3581-kube-api-access-lhxjh\") pod \"ovnkube-node-gq5p9\" (UID: \"6e6f28ae-470c-4e2b-aefc-3ee361ed3581\") " pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:34.974379 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:34.974318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84jc\" (UniqueName: \"kubernetes.io/projected/58775b98-3ad6-4949-8eea-804ce2783a3f-kube-api-access-j84jc\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:35.046877 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.046839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4hxb" Sep 07 03:57:35.054116 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.054094 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" Sep 07 03:57:35.063945 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.063916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" Sep 07 03:57:35.071570 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.071552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5rz6f" Sep 07 03:57:35.079294 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.079272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dfz9w" Sep 07 03:57:35.084980 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.084961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz99m" Sep 07 03:57:35.093768 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.093741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:57:35.100688 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.100652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:35.106599 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.106579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ccfcr" Sep 07 03:57:35.466849 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.466810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:35.467050 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.466865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:35.467050 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.466918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:35.467050 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467000 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:35.467050 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467019 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:35.467050 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467032 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:35.467230 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467054 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:35.467230 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467104 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:57:36.467091319 +0000 UTC m=+4.122659843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:35.467230 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467111 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:35.467230 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467123 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:57:36.467113628 +0000 UTC m=+4.122682149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:35.467230 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.467158 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:36.467145351 +0000 UTC m=+4.122713877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:35.788341 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.788233 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:52:34 +0000 UTC" deadline="2028-03-31 04:36:14.311304655 +0000 UTC" Sep 07 03:57:35.788341 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.788294 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13704h38m38.523013203s" Sep 07 03:57:35.852623 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:35.852588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:35.852822 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:35.852759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:35.870258 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.870234 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebfbf69_5462_4af2_aedf_01685306f527.slice/crio-c6a8221a5b95e9fba362303c4c0aa4b6b7f45ac0aa5f836de0507586f2c3f355 WatchSource:0}: Error finding container c6a8221a5b95e9fba362303c4c0aa4b6b7f45ac0aa5f836de0507586f2c3f355: Status 404 returned error can't find the container with id c6a8221a5b95e9fba362303c4c0aa4b6b7f45ac0aa5f836de0507586f2c3f355 Sep 07 03:57:35.870683 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.870654 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad8ec9f_35dd_4028_b350_43bfb07a7a88.slice/crio-51d168fecec8f299c528d699b522be97512b1ff7df7bc28d8616c7ca0d749374 WatchSource:0}: Error finding container 51d168fecec8f299c528d699b522be97512b1ff7df7bc28d8616c7ca0d749374: Status 404 returned error can't find the container with id 51d168fecec8f299c528d699b522be97512b1ff7df7bc28d8616c7ca0d749374 Sep 07 03:57:35.871795 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.871773 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc9200f_e8a9_41ff_9d6a_8dbc98719864.slice/crio-d7b85d11d1de7058b2d4c5b9ec5607d1e8c054d338e9da66bcc3c23d5dbc13c3 WatchSource:0}: Error finding container d7b85d11d1de7058b2d4c5b9ec5607d1e8c054d338e9da66bcc3c23d5dbc13c3: Status 404 returned error can't find the container with id d7b85d11d1de7058b2d4c5b9ec5607d1e8c054d338e9da66bcc3c23d5dbc13c3 Sep 07 03:57:35.874544 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.874505 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a199ad_8452_4357_9503_6a6c916f32f3.slice/crio-b1ea75d9ee65c01705197f2d77c2bcc52e7194f8c17c62bf635741ba58a63c11 WatchSource:0}: Error finding container b1ea75d9ee65c01705197f2d77c2bcc52e7194f8c17c62bf635741ba58a63c11: Status 404 returned error can't find the container with id b1ea75d9ee65c01705197f2d77c2bcc52e7194f8c17c62bf635741ba58a63c11 Sep 07 03:57:35.876703 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.876663 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeda21c4_e267_4bb3_b5a2_0cdb437c557e.slice/crio-ac6f9f6e3bb67ae094a6a9bb30bf01235ab02bc1c96d8197b6de567a2880ce28 WatchSource:0}: Error finding container ac6f9f6e3bb67ae094a6a9bb30bf01235ab02bc1c96d8197b6de567a2880ce28: Status 404 returned error can't find the container with id ac6f9f6e3bb67ae094a6a9bb30bf01235ab02bc1c96d8197b6de567a2880ce28 Sep 07 03:57:35.877531 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.877496 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6f28ae_470c_4e2b_aefc_3ee361ed3581.slice/crio-9a7c6ddbd6092081a157dea4b204397489898fb0218721cc646f6c7531383f15 WatchSource:0}: Error finding container 9a7c6ddbd6092081a157dea4b204397489898fb0218721cc646f6c7531383f15: Status 404 returned error can't find the container with id 9a7c6ddbd6092081a157dea4b204397489898fb0218721cc646f6c7531383f15 Sep 07 03:57:35.878254 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.878240 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa873af_9b8e_4d7e_b201_5a940dcb9e93.slice/crio-f399f9e5684349f7c74a8e819c1d8b6bb1ca1c55b9305a6b454fb4213bf57ada WatchSource:0}: Error finding container f399f9e5684349f7c74a8e819c1d8b6bb1ca1c55b9305a6b454fb4213bf57ada: Status 404 returned error can't find the container with id f399f9e5684349f7c74a8e819c1d8b6bb1ca1c55b9305a6b454fb4213bf57ada Sep 07 03:57:35.879866 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.879768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205d4303_a34a_4794_a22b_1299d028f459.slice/crio-3108d35fb11f65c11dd26bfd53369afa7d5353e76d07a0aef1684769bb45a2d6 WatchSource:0}: Error finding container 3108d35fb11f65c11dd26bfd53369afa7d5353e76d07a0aef1684769bb45a2d6: Status 404 returned error can't find the container with id 3108d35fb11f65c11dd26bfd53369afa7d5353e76d07a0aef1684769bb45a2d6 Sep 07 03:57:35.880891 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:57:35.880804 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60125676_ef69_4ee5_8463_ff00c7735c9a.slice/crio-fff1f371d2735fb2a4a063da23620923ff4522235a2267c83051b15d191c3946 WatchSource:0}: Error finding container fff1f371d2735fb2a4a063da23620923ff4522235a2267c83051b15d191c3946: Status 404 returned error can't find the container with id fff1f371d2735fb2a4a063da23620923ff4522235a2267c83051b15d191c3946 Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.475131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.475392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.475433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475573 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475641 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:57:38.47562079 +0000 UTC m=+6.131189314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475728 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475764 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:38.475751539 +0000 UTC m=+6.131320062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475845 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475860 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475874 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:36.476253 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.475911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:57:38.475900267 +0000 UTC m=+6.131468795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:36.790742 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.788707 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:52:34 +0000 UTC" deadline="2028-02-21 03:32:34.994500984 +0000 UTC" Sep 07 03:57:36.790742 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.788752 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12767h34m58.205754809s" Sep 07 03:57:36.854186 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.854158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:36.854365 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.854278 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:36.854504 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.854480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:36.854629 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:36.854605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:36.872387 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.872288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" event={"ID":"beda21c4-e267-4bb3-b5a2-0cdb437c557e","Type":"ContainerStarted","Data":"ac6f9f6e3bb67ae094a6a9bb30bf01235ab02bc1c96d8197b6de567a2880ce28"} Sep 07 03:57:36.885135 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.885061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmhtt" event={"ID":"69a199ad-8452-4357-9503-6a6c916f32f3","Type":"ContainerStarted","Data":"b1ea75d9ee65c01705197f2d77c2bcc52e7194f8c17c62bf635741ba58a63c11"} Sep 07 03:57:36.900011 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.899975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ccfcr" event={"ID":"7bc9200f-e8a9-41ff-9d6a-8dbc98719864","Type":"ContainerStarted","Data":"d7b85d11d1de7058b2d4c5b9ec5607d1e8c054d338e9da66bcc3c23d5dbc13c3"} Sep 07 03:57:36.908376 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.908337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfz9w" event={"ID":"0ad8ec9f-35dd-4028-b350-43bfb07a7a88","Type":"ContainerStarted","Data":"51d168fecec8f299c528d699b522be97512b1ff7df7bc28d8616c7ca0d749374"} Sep 07 03:57:36.913610 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.913577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5rz6f" event={"ID":"6ebfbf69-5462-4af2-aedf-01685306f527","Type":"ContainerStarted","Data":"c6a8221a5b95e9fba362303c4c0aa4b6b7f45ac0aa5f836de0507586f2c3f355"} Sep 07 03:57:36.933897 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.933863 2579 generic.go:356] "Generic (PLEG): container finished" podID="327991e56010d9bc65c5501f742e0222" containerID="760537e9ee3444b8d2e4ed9e7806004fb281cad893152de993f2c7b5b2f05fff" exitCode=0 Sep 07 03:57:36.934043 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.933953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"327991e56010d9bc65c5501f742e0222","Type":"ContainerDied","Data":"760537e9ee3444b8d2e4ed9e7806004fb281cad893152de993f2c7b5b2f05fff"} Sep 07 03:57:36.947735 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.947704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" event={"ID":"c8abc5811eae218b508d7d4b044d4dc6","Type":"ContainerStarted","Data":"c353441a7b88234487cd5563fa371e49489cee46754b9d1491614ea5e50fdb10"} Sep 07 03:57:36.972655 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.972618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerStarted","Data":"fff1f371d2735fb2a4a063da23620923ff4522235a2267c83051b15d191c3946"} Sep 07 03:57:36.983136 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.983098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4hxb" event={"ID":"205d4303-a34a-4794-a22b-1299d028f459","Type":"ContainerStarted","Data":"3108d35fb11f65c11dd26bfd53369afa7d5353e76d07a0aef1684769bb45a2d6"} Sep 07 03:57:36.992611 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:36.992567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" event={"ID":"6fa873af-9b8e-4d7e-b201-5a940dcb9e93","Type":"ContainerStarted","Data":"f399f9e5684349f7c74a8e819c1d8b6bb1ca1c55b9305a6b454fb4213bf57ada"} Sep 07 03:57:37.005267 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:37.005234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"9a7c6ddbd6092081a157dea4b204397489898fb0218721cc646f6c7531383f15"} Sep 07 03:57:37.853385 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:37.852780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:37.853385 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:37.852925 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:38.016792 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.016744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"327991e56010d9bc65c5501f742e0222","Type":"ContainerStarted","Data":"888f520a4f69ee5c3a5c65eb3a033641eb970e434d675724e92be5447fe1d0e8"} Sep 07 03:57:38.032164 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.032102 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" podStartSLOduration=4.032081379 podStartE2EDuration="4.032081379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:36.96652615 +0000 UTC m=+4.622094693" watchObservedRunningTime="2026-09-07 03:57:38.032081379 +0000 UTC m=+5.687649923" Sep 07 03:57:38.498567 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.498528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:38.498786 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.498590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:38.498786 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.498630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:38.498786 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.498771 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:38.498958 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.498835 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:57:42.49881631 +0000 UTC m=+10.154384847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:38.499275 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499255 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:38.499365 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:42.499296817 +0000 UTC m=+10.154865360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:38.499429 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499394 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:38.499429 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499408 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:38.499429 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499421 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:38.499565 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.499458 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:57:42.499446238 +0000 UTC m=+10.155014781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:38.852425 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.852346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:38.852605 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.852482 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:38.853008 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:38.852988 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:38.853103 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:38.853080 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:39.852707 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:39.852642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:39.853164 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:39.852815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:40.852618 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:40.852363 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:40.852618 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:40.852401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:40.852618 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:40.852493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:40.852618 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:40.852602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:41.852700 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:41.852654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:41.852847 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:41.852807 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:42.532712 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:42.532553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:42.532712 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:42.532636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:42.532712 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:42.532689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532726 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532802 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.532785603 +0000 UTC m=+18.188354129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532830 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532852 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532865 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.532896392 +0000 UTC m=+18.188464919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.532978 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:42.533441 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.533012 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.533000285 +0000 UTC m=+18.188568818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:42.853573 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:42.852906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:42.853573 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.853028 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:42.853573 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:42.853398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:42.853573 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:42.853484 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:43.854454 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:43.852753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:43.854454 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:43.852903 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:44.852559 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:44.852522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:44.852735 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:44.852662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:44.852988 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:44.852522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:44.853088 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:44.853069 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:45.852632 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:45.852602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:45.853111 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:45.852718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:46.852453 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:46.852422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:46.852632 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:46.852422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:46.852632 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:46.852545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:46.853070 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:46.852635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:47.851755 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:47.851712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:47.851946 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:47.851845 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:48.852349 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:48.852311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:48.852779 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:48.852369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:48.852779 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:48.852462 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:48.852779 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:48.852608 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:49.851741 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:49.851706 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:49.851974 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:49.851818 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:50.591871 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:50.591831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:50.591893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:50.591931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592015 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592062 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592082 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:58:06.592066024 +0000 UTC m=+34.247634564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592134 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:06.592114357 +0000 UTC m=+34.247682887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592141 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592161 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592171 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.592362 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.592211 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:58:06.592197036 +0000 UTC m=+34.247765556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.852297 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:50.852205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:50.852453 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:50.852219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:50.852453 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.852334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:50.852453 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:50.852438 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:51.852105 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:51.852067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:51.852573 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:51.852210 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:52.853018 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:52.852978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:52.853446 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:52.853120 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:52.853446 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:52.853181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:52.853446 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:52.853300 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:53.852743 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:53.852703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:53.852917 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:53.852833 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:54.067389 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:54.066797 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" event={"ID":"beda21c4-e267-4bb3-b5a2-0cdb437c557e","Type":"ContainerStarted","Data":"a19644ae30f65c6676009df451d9c64eff9bacf1f794564faf6b382dd235bed8"} Sep 07 03:57:54.083364 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:54.083312 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" podStartSLOduration=20.083291794 podStartE2EDuration="20.083291794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:38.033437209 +0000 UTC m=+5.689005756" watchObservedRunningTime="2026-09-07 03:57:54.083291794 +0000 UTC m=+21.738860338" Sep 07 03:57:54.100283 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:54.100225 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8j7x2" podStartSLOduration=3.097433995 podStartE2EDuration="21.100202102s" totalImagesPullingTime="18.002768107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:54.083398427 +0000 UTC m=+21.738966987" watchObservedRunningTime="2026-09-07 03:57:54.100202102 +0000 UTC m=+21.755770646" Sep 07 03:57:54.852628 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:54.852410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:54.852888 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:54.852411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:54.852888 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:54.852688 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:54.852888 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:54.852777 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:55.078818 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.078778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"1b1c89223d4bc89a25ce55035584ffcae88101d8a281383fc8ba2455d8778ec8"} Sep 07 03:57:55.079384 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.078880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"37c6c746a0edd0f091b2b7385dc3e63f19dca4e5a7fb8b0b955c461d17ab2978"} Sep 07 03:57:55.079384 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.078939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"ecc453e1a56ab9383f22c2d1ff3afd54396ab8fd3dd7969ceebf879564a364e2"} Sep 07 03:57:55.079384 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.078986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"8135eeb29d7a624adc02f225b8b5f38704731ddf0882b813e8c95554c9d520a8"} Sep 07 03:57:55.079384 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.079020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"fff1be079649a0c0dc306e3ee6cb7fb2742d7a02e7d135f6a48de168fc3ffc39"} Sep 07 03:57:55.079384 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.079062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"4ccc1eb79a4ba0274a05b1d056e8c7f08ca632834bba522a41a532d9b5279849"} Sep 07 03:57:55.080186 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.080163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmhtt" event={"ID":"69a199ad-8452-4357-9503-6a6c916f32f3","Type":"ContainerStarted","Data":"f635d647cd4014356460e4aa8a0b20126e62086bd1137971bc769e6344680db9"} Sep 07 03:57:55.081587 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.081568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ccfcr" event={"ID":"7bc9200f-e8a9-41ff-9d6a-8dbc98719864","Type":"ContainerStarted","Data":"4f276c314b2abdbe9b3eda32fba0ec9500f138274e0abfb7a0aa8783ac0b8b0c"} Sep 07 03:57:55.083079 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.083057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dfz9w" event={"ID":"0ad8ec9f-35dd-4028-b350-43bfb07a7a88","Type":"ContainerStarted","Data":"9520ff839804fbac765109eee95950b11fe331b7afc5d65e32ce097a69444125"} Sep 07 03:57:55.084398 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.084366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5rz6f" event={"ID":"6ebfbf69-5462-4af2-aedf-01685306f527","Type":"ContainerStarted","Data":"a554ab76bf776480f908260f2514fbcf3645dfb7560d2187773c987568501e25"} Sep 07 03:57:55.086043 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.086019 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="b9cb468a4dc3f648a01b3fd098053f5c09805273c71ef9a42a086c10a59f6a0e" exitCode=0 Sep 07 03:57:55.086138 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.086094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"b9cb468a4dc3f648a01b3fd098053f5c09805273c71ef9a42a086c10a59f6a0e"} Sep 07 03:57:55.087620 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.087601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" event={"ID":"6fa873af-9b8e-4d7e-b201-5a940dcb9e93","Type":"ContainerStarted","Data":"ce19d67591c02f468c5ae8237eee606f79756ea297fe5e9432a9062a8549788d"} Sep 07 03:57:55.100536 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.100497 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xmhtt" podStartSLOduration=8.037486882 podStartE2EDuration="22.100484763s" totalImagesPullingTime="14.062997881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:54.10114244 +0000 UTC m=+21.756710984" watchObservedRunningTime="2026-09-07 03:57:55.100484763 +0000 UTC m=+22.756053379" Sep 07 03:57:55.100659 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.100641 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ccfcr" podStartSLOduration=4.03305486 podStartE2EDuration="22.10063725s" totalImagesPullingTime="18.06758239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:55.100352164 +0000 UTC m=+22.755920707" watchObservedRunningTime="2026-09-07 03:57:55.10063725 +0000 UTC m=+22.756205792" Sep 07 03:57:55.115066 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.115003 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dfz9w" podStartSLOduration=4.1244669 podStartE2EDuration="22.114990388s" totalImagesPullingTime="17.990523488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:55.114905032 +0000 UTC m=+22.770473576" watchObservedRunningTime="2026-09-07 03:57:55.114990388 +0000 UTC m=+22.770558930" Sep 07 03:57:55.152777 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.152728 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5rz6f" podStartSLOduration=4.161381587 podStartE2EDuration="22.152717241s" totalImagesPullingTime="17.991335654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:55.152586685 +0000 UTC m=+22.808155227" watchObservedRunningTime="2026-09-07 03:57:55.152717241 +0000 UTC m=+22.808285784" Sep 07 03:57:55.352365 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.352340 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 03:57:55.550399 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.550359 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:55.551319 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.551300 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:55.852378 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.852273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:55.852544 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:55.852463 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:55.955585 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.955486 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T03:57:55.352359783Z","UUID":"7c22af82-aaf4-4d83-964c-7418a5f510f8","Handler":null,"Name":"","Endpoint":""} Sep 07 03:57:55.957454 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.957431 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 03:57:55.957585 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:55.957468 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 03:57:56.092401 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.092365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4hxb" event={"ID":"205d4303-a34a-4794-a22b-1299d028f459","Type":"ContainerStarted","Data":"4e9d18ebb931de7c485cbbf5e85c34ecbf6ff9b78078dc41b8d89192cb51f911"} Sep 07 03:57:56.096375 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.096343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" event={"ID":"6fa873af-9b8e-4d7e-b201-5a940dcb9e93","Type":"ContainerStarted","Data":"1f94908411a41226e1c8271782c59ce286c3c92a84fd09ef01140b5a99661cf4"} Sep 07 03:57:56.096525 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.096504 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:56.097086 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.097067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xmhtt" Sep 07 03:57:56.108288 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.108216 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m4hxb" podStartSLOduration=5.126356258 podStartE2EDuration="23.10819968s" totalImagesPullingTime="17.981843422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:56.107763712 +0000 UTC m=+23.763332254" watchObservedRunningTime="2026-09-07 03:57:56.10819968 +0000 UTC m=+23.763768225" Sep 07 03:57:56.851944 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.851855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:56.851944 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:56.851894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:56.852161 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:56.851999 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:56.852225 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:56.852153 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:57.100534 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:57.100496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" event={"ID":"6fa873af-9b8e-4d7e-b201-5a940dcb9e93","Type":"ContainerStarted","Data":"3aed8eb26ff7c3e04e5d704da00ca3bd9414e01aeb69d427d926b34c2fc7078b"} Sep 07 03:57:57.104686 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:57.104605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"128fb575f946c947077504d34536705ac7274d3c93a6ea184db6704639e98723"} Sep 07 03:57:57.121242 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:57.119169 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97fzx" podStartSLOduration=4.081508552 podStartE2EDuration="24.119150758s" totalImagesPullingTime="20.037642206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:57.117964287 +0000 UTC m=+24.773532832" watchObservedRunningTime="2026-09-07 03:57:57.119150758 +0000 UTC m=+24.774719303" Sep 07 03:57:57.852640 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:57.852453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:57.852826 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:57.852736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:57:58.851894 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:58.851864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:57:58.851894 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:58.851880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:57:58.852380 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:58.852023 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:57:58.852380 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:58.852036 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:57:59.852047 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:57:59.851880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:57:59.852467 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:57:59.852122 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:58:00.117162 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.117082 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="b7c8800985ffdec791de12ba3c31650fd3514aa34f3feeacdd89cbb1c02f1ebb" exitCode=0 Sep 07 03:58:00.117350 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.117175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"b7c8800985ffdec791de12ba3c31650fd3514aa34f3feeacdd89cbb1c02f1ebb"} Sep 07 03:58:00.121271 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.121250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" event={"ID":"6e6f28ae-470c-4e2b-aefc-3ee361ed3581","Type":"ContainerStarted","Data":"9df6038b16e8b1fe61a2234d0957965d2b2d27b08a35d9ee077a17ba220db8ed"} Sep 07 03:58:00.121950 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.121604 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:00.121950 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.121695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:00.121950 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.121750 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:00.136899 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.136878 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:00.140091 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.140076 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:00.162624 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.162579 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" podStartSLOduration=9.118454277 podStartE2EDuration="27.162565337s" totalImagesPullingTime="18.04411106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:00.162424684 +0000 UTC m=+27.817993227" watchObservedRunningTime="2026-09-07 03:58:00.162565337 +0000 UTC m=+27.818133879" Sep 07 03:58:00.852249 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.852221 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:00.852986 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:00.852353 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:58:00.852986 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:00.852417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:00.852986 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:00.852575 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:58:01.098954 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.098871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7bxz"] Sep 07 03:58:01.099122 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.099006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:01.099186 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:01.099111 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:58:01.103188 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.103158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6hr6m"] Sep 07 03:58:01.103843 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.103808 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62s55"] Sep 07 03:58:01.126742 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.126706 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="b29edbbc7449f956465c6e6b044d1a77322ac2dace6673c116a81aefebd1c48b" exitCode=0 Sep 07 03:58:01.126923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.126779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"b29edbbc7449f956465c6e6b044d1a77322ac2dace6673c116a81aefebd1c48b"} Sep 07 03:58:01.126923 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.126790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:01.127026 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:01.126928 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:58:01.127026 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:01.126988 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:01.127130 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:01.127112 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:58:02.131307 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:02.131218 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="d1188e91016308ecafb13771b3ad496088972c3342de5470d1fd897d7b9cbfe4" exitCode=0 Sep 07 03:58:02.131760 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:02.131307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"d1188e91016308ecafb13771b3ad496088972c3342de5470d1fd897d7b9cbfe4"} Sep 07 03:58:02.853685 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:02.853649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:02.853890 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:02.853763 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:58:02.854093 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:02.854076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:02.854167 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:02.854148 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:58:02.854228 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:02.854198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:02.854277 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:02.854266 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:58:04.852641 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:04.852612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:04.853100 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:04.852644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:04.853100 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:04.852644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:04.853100 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:04.852760 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62s55" podUID="b4825a67-5eab-424f-ab28-89673cf69e2d" Sep 07 03:58:04.853100 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:04.852866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 03:58:04.853100 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:04.852958 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7bxz" podUID="87010d61-5656-4487-ab32-47577943ddf5" Sep 07 03:58:06.612503 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.612474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.612517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612619 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.612637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612626 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612727 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612728 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612770 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qpvzn for pod openshift-network-diagnostics/network-check-target-62s55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612699 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret podName:87010d61-5656-4487-ab32-47577943ddf5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.612681655 +0000 UTC m=+66.268250188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret") pod "global-pull-secret-syncer-q7bxz" (UID: "87010d61-5656-4487-ab32-47577943ddf5") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612805 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.612792717 +0000 UTC m=+66.268361239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:06.612834 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:06.612820 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn podName:b4825a67-5eab-424f-ab28-89673cf69e2d nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.612814482 +0000 UTC m=+66.268383002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qpvzn" (UniqueName: "kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn") pod "network-check-target-62s55" (UID: "b4825a67-5eab-424f-ab28-89673cf69e2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:06.683919 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.683846 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeReady" Sep 07 03:58:06.684062 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.683973 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 03:58:06.721319 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.721275 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p"] Sep 07 03:58:06.735485 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.735451 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt"] Sep 07 03:58:06.735685 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.735595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.739811 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.739483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 03:58:06.739811 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.739594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 03:58:06.739811 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.739771 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5tsvp\"" Sep 07 03:58:06.740075 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.740049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 07 03:58:06.742434 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.742414 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 03:58:06.749582 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.749555 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 03:58:06.749731 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.749709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:06.752766 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.752743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 07 03:58:06.763397 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.763374 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk"] Sep 07 03:58:06.763530 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.763511 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.766139 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.766118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 03:58:06.766257 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.766123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dlnc5\"" Sep 07 03:58:06.766257 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.766148 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 03:58:06.766257 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.766129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 03:58:06.771451 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.771401 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 03:58:06.781576 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.781547 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-z6qqf"] Sep 07 03:58:06.781711 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.781694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.784421 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.784396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 07 03:58:06.784421 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.784419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 07 03:58:06.784597 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.784447 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 07 03:58:06.784597 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.784529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 07 03:58:06.807636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.807600 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p"] Sep 07 03:58:06.807636 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.807636 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-z6qqf"] Sep 07 03:58:06.807869 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.807657 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt"] Sep 07 03:58:06.807869 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.807702 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mt8sr"] Sep 07 03:58:06.807869 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.807791 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:06.810271 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.810246 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 07 03:58:06.810271 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.810265 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 07 03:58:06.810271 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.810249 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c4swx\"" Sep 07 03:58:06.814769 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.814750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a982befc-13af-43de-b19d-d159d8765112-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.814887 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.814776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskbp\" (UniqueName: \"kubernetes.io/projected/a982befc-13af-43de-b19d-d159d8765112-kube-api-access-jskbp\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.823613 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.823590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk"] Sep 07 03:58:06.823743 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.823662 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dzjl7"] Sep 07 03:58:06.823805 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.823748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:06.826583 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.826555 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 03:58:06.826715 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.826565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 03:58:06.826788 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.826728 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 03:58:06.826838 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.826801 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rbnhc\"" Sep 07 03:58:06.845639 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.845612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mt8sr"] Sep 07 03:58:06.845763 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.845651 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 03:58:06.845763 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.845701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzjl7"] Sep 07 03:58:06.845763 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.845757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:06.848651 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.848630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 03:58:06.848769 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.848714 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9sb\"" Sep 07 03:58:06.848769 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.848747 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 03:58:06.851758 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.851740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:06.851758 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.851747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:06.852091 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.852059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:06.856451 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 03:58:06.857245 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 03:58:06.857245 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbtcj\"" Sep 07 03:58:06.857245 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856603 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 03:58:06.857245 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrlx9\"" Sep 07 03:58:06.857245 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.856832 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 03:58:06.915262 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-nginx-conf\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:06.915262 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869nl\" (UniqueName: \"kubernetes.io/projected/31370701-a241-4364-84cd-0551358f7870-kube-api-access-869nl\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb8cx\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c1262da-6354-4c9c-aa89-92ce211fc6a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:06.915444 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aff9fd53-4913-4dc1-946d-bbc356ade55e-config-volume\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqz5\" (UniqueName: \"kubernetes.io/projected/19441606-9e51-41af-b8bb-bd1902f098b1-kube-api-access-8mqz5\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19441606-9e51-41af-b8bb-bd1902f098b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a982befc-13af-43de-b19d-d159d8765112-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff9fd53-4913-4dc1-946d-bbc356ade55e-tmp-dir\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskbp\" (UniqueName: \"kubernetes.io/projected/a982befc-13af-43de-b19d-d159d8765112-kube-api-access-jskbp\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.915733 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19441606-9e51-41af-b8bb-bd1902f098b1-tmp\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:06.916180 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wz56\" (UniqueName: \"kubernetes.io/projected/aff9fd53-4913-4dc1-946d-bbc356ade55e-kube-api-access-6wz56\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:06.916180 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.916180 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31370701-a241-4364-84cd-0551358f7870-cert\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:06.916180 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.916180 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.915857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r98ht\" (UniqueName: \"kubernetes.io/projected/5c1262da-6354-4c9c-aa89-92ce211fc6a2-kube-api-access-r98ht\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:06.919904 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.919881 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a982befc-13af-43de-b19d-d159d8765112-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:06.923912 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:06.923891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskbp\" (UniqueName: \"kubernetes.io/projected/a982befc-13af-43de-b19d-d159d8765112-kube-api-access-jskbp\") pod \"managed-serviceaccount-addon-agent-54b7b87644-7z96p\" (UID: \"a982befc-13af-43de-b19d-d159d8765112\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:07.016866 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff9fd53-4913-4dc1-946d-bbc356ade55e-tmp-dir\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19441606-9e51-41af-b8bb-bd1902f098b1-tmp\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wz56\" (UniqueName: \"kubernetes.io/projected/aff9fd53-4913-4dc1-946d-bbc356ade55e-kube-api-access-6wz56\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.016986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.017049 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31370701-a241-4364-84cd-0551358f7870-cert\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r98ht\" (UniqueName: \"kubernetes.io/projected/5c1262da-6354-4c9c-aa89-92ce211fc6a2-kube-api-access-r98ht\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-nginx-conf\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff9fd53-4913-4dc1-946d-bbc356ade55e-tmp-dir\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017667 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19441606-9e51-41af-b8bb-bd1902f098b1-tmp\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869nl\" (UniqueName: \"kubernetes.io/projected/31370701-a241-4364-84cd-0551358f7870-kube-api-access-869nl\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb8cx\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c1262da-6354-4c9c-aa89-92ce211fc6a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.017977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aff9fd53-4913-4dc1-946d-bbc356ade55e-config-volume\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.019729 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqz5\" (UniqueName: \"kubernetes.io/projected/19441606-9e51-41af-b8bb-bd1902f098b1-kube-api-access-8mqz5\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19441606-9e51-41af-b8bb-bd1902f098b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018636 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-nginx-conf\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.018960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.019060 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.019076 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.019173 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:07.519113478 +0000 UTC m=+35.174682017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.019190 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aff9fd53-4913-4dc1-946d-bbc356ade55e-config-volume\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.019272 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.019330 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:07.519314648 +0000 UTC m=+35.174883191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.019931 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c1262da-6354-4c9c-aa89-92ce211fc6a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.020017 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:07.020575 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.020066 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:07.520047737 +0000 UTC m=+35.175616273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:07.021240 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.020235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31370701-a241-4364-84cd-0551358f7870-cert\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:07.021240 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.020665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.021240 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.020710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.021240 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.021191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.021240 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.021236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-hub\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.021417 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.021282 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c1262da-6354-4c9c-aa89-92ce211fc6a2-ca\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.022207 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.022179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/19441606-9e51-41af-b8bb-bd1902f098b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.022335 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.022319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.025074 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.025052 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.025522 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.025501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wz56\" (UniqueName: \"kubernetes.io/projected/aff9fd53-4913-4dc1-946d-bbc356ade55e-kube-api-access-6wz56\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.025601 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.025570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r98ht\" (UniqueName: \"kubernetes.io/projected/5c1262da-6354-4c9c-aa89-92ce211fc6a2-kube-api-access-r98ht\") pod \"cluster-proxy-proxy-agent-54c45c8c7d-jj5kk\" (UID: \"5c1262da-6354-4c9c-aa89-92ce211fc6a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.026460 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.026431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-869nl\" (UniqueName: \"kubernetes.io/projected/31370701-a241-4364-84cd-0551358f7870-kube-api-access-869nl\") pod \"ingress-canary-mt8sr\" (UID: \"31370701-a241-4364-84cd-0551358f7870\") " pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:07.027533 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.027513 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb8cx\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.028364 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.028345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqz5\" (UniqueName: \"kubernetes.io/projected/19441606-9e51-41af-b8bb-bd1902f098b1-kube-api-access-8mqz5\") pod \"klusterlet-addon-workmgr-696855bb74-ssggt\" (UID: \"19441606-9e51-41af-b8bb-bd1902f098b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.056777 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.056747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 03:58:07.065946 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.065920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:07.089452 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.089427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 03:58:07.136068 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.136033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mt8sr" Sep 07 03:58:07.149752 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.149716 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="d384071285452a7bd40b43a42d15e4455c83277775c2486c6cf32bb5f61d38e9" exitCode=0 Sep 07 03:58:07.149922 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.149813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"d384071285452a7bd40b43a42d15e4455c83277775c2486c6cf32bb5f61d38e9"} Sep 07 03:58:07.392533 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.392331 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p"] Sep 07 03:58:07.394790 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.394774 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt"] Sep 07 03:58:07.414365 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.414336 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk"] Sep 07 03:58:07.445512 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.445402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mt8sr"] Sep 07 03:58:07.448078 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:07.448042 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda982befc_13af_43de_b19d_d159d8765112.slice/crio-b0e8b1312fb69180c8ba6216cdbad14f8e03b3075d03a55eadf24f067a20e332 WatchSource:0}: Error finding container b0e8b1312fb69180c8ba6216cdbad14f8e03b3075d03a55eadf24f067a20e332: Status 404 returned error can't find the container with id b0e8b1312fb69180c8ba6216cdbad14f8e03b3075d03a55eadf24f067a20e332 Sep 07 03:58:07.449083 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:07.449053 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19441606_9e51_41af_b8bb_bd1902f098b1.slice/crio-685a11afd90d106397c60d5f16ef966f381643d424dd841cae080d8874e5b953 WatchSource:0}: Error finding container 685a11afd90d106397c60d5f16ef966f381643d424dd841cae080d8874e5b953: Status 404 returned error can't find the container with id 685a11afd90d106397c60d5f16ef966f381643d424dd841cae080d8874e5b953 Sep 07 03:58:07.449334 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:07.449305 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c1262da_6354_4c9c_aa89_92ce211fc6a2.slice/crio-1d7d7664383ea761cad2c3b91082da005fd2aa5ec8c8a349b2ec495eab96ccea WatchSource:0}: Error finding container 1d7d7664383ea761cad2c3b91082da005fd2aa5ec8c8a349b2ec495eab96ccea: Status 404 returned error can't find the container with id 1d7d7664383ea761cad2c3b91082da005fd2aa5ec8c8a349b2ec495eab96ccea Sep 07 03:58:07.451478 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:07.451040 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31370701_a241_4364_84cd_0551358f7870.slice/crio-6045a7f55cc0d8b7c82a61f139bad92d37666f383d99e30d7fd6ab5ec53f5f24 WatchSource:0}: Error finding container 6045a7f55cc0d8b7c82a61f139bad92d37666f383d99e30d7fd6ab5ec53f5f24: Status 404 returned error can't find the container with id 6045a7f55cc0d8b7c82a61f139bad92d37666f383d99e30d7fd6ab5ec53f5f24 Sep 07 03:58:07.521952 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.521850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:07.521952 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.521910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522001 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522009 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522028 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522047 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:08.522033549 +0000 UTC m=+36.177602074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:07.522050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522070 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:08.522057024 +0000 UTC m=+36.177625545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522129 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:07.522203 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:07.522181 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:08.522166259 +0000 UTC m=+36.177734780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:08.153666 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.153622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerStarted","Data":"685a11afd90d106397c60d5f16ef966f381643d424dd841cae080d8874e5b953"} Sep 07 03:58:08.157214 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.157184 2579 generic.go:356] "Generic (PLEG): container finished" podID="60125676-ef69-4ee5-8463-ff00c7735c9a" containerID="a1d1a18aea3d27e19f2436b0235e21afb1df9dbc359407bf10b2a405c1f182f3" exitCode=0 Sep 07 03:58:08.157361 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.157288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerDied","Data":"a1d1a18aea3d27e19f2436b0235e21afb1df9dbc359407bf10b2a405c1f182f3"} Sep 07 03:58:08.158614 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.158592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerStarted","Data":"b0e8b1312fb69180c8ba6216cdbad14f8e03b3075d03a55eadf24f067a20e332"} Sep 07 03:58:08.159998 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.159975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mt8sr" event={"ID":"31370701-a241-4364-84cd-0551358f7870","Type":"ContainerStarted","Data":"6045a7f55cc0d8b7c82a61f139bad92d37666f383d99e30d7fd6ab5ec53f5f24"} Sep 07 03:58:08.161698 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.161662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerStarted","Data":"1d7d7664383ea761cad2c3b91082da005fd2aa5ec8c8a349b2ec495eab96ccea"} Sep 07 03:58:08.531661 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.531451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:08.531661 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.531605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:08.531661 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:08.531646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:08.531661 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531653 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531695 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531765 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:10.531742902 +0000 UTC m=+38.187311424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531792 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531917 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:10.531900116 +0000 UTC m=+38.187468655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.531983 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:08.532014 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:08.532018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:10.53200732 +0000 UTC m=+38.187575858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:09.176615 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:09.176573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz99m" event={"ID":"60125676-ef69-4ee5-8463-ff00c7735c9a","Type":"ContainerStarted","Data":"ab9810e44decc37c3df784ca364dc7adc88527100c8591f87559b8f52abf8f31"} Sep 07 03:58:09.202555 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:09.202278 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zz99m" podStartSLOduration=8.510440622 podStartE2EDuration="36.202256108s" totalImagesPullingTime="27.691815486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.19995231 +0000 UTC m=+36.855520854" watchObservedRunningTime="2026-09-07 03:58:09.202256108 +0000 UTC m=+36.857824654" Sep 07 03:58:10.553017 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:10.552980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:10.553039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553159 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553164 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553188 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553221 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:14.55320368 +0000 UTC m=+42.208772227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553240 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:14.553230969 +0000 UTC m=+42.208799504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:10.553258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553342 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:10.553648 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:10.553376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:14.553366169 +0000 UTC m=+42.208934704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:14.594318 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:14.594282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:14.594331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:14.594358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594466 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594513 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594537 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594466 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594523 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:22.594509164 +0000 UTC m=+50.250077684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:22.59458857 +0000 UTC m=+50.250157095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:14.594788 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:14.594614 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:22.594608494 +0000 UTC m=+50.250177016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:17.201807 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.201768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerStarted","Data":"6b9c831981e670d1063dbc3f5af350bf991a4e6ea65a0c9819f03709cdcc769a"} Sep 07 03:58:17.203425 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.203394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mt8sr" event={"ID":"31370701-a241-4364-84cd-0551358f7870","Type":"ContainerStarted","Data":"b3d53f7b549c84ecea1db5414da47362128e67778a1efb9cb23f2447eb54a5c9"} Sep 07 03:58:17.205482 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.205455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerStarted","Data":"49699f862f2df934cf3e9c67e82b3eeadf276dc6331fdd84bede6a2399b0e46f"} Sep 07 03:58:17.205582 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.205493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerStarted","Data":"2d6789e3af3e6564f7e47e1b247ce6d0d57e668057dc13314a1753841bad1688"} Sep 07 03:58:17.205582 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.205511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerStarted","Data":"1e7f41f4c39ce46d14d348e3a277c11537f5b585fec853bd7365c0bcb1893762"} Sep 07 03:58:17.210094 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.210069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerStarted","Data":"90be60f3d264385d599a92ff850ee5f205fe8233430fb3f976e32ef73ffe62f7"} Sep 07 03:58:17.210209 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.210190 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:17.211758 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.211737 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 03:58:17.220639 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.220585 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" podStartSLOduration=12.402005308 podStartE2EDuration="21.220574687s" totalImagesPullingTime="8.818569379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:17.220421309 +0000 UTC m=+44.875989852" watchObservedRunningTime="2026-09-07 03:58:17.220574687 +0000 UTC m=+44.876143229" Sep 07 03:58:17.238814 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.238772 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mt8sr" podStartSLOduration=2.423020979 podStartE2EDuration="11.238758515s" totalImagesPullingTime="8.815737536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:17.238109291 +0000 UTC m=+44.893677834" watchObservedRunningTime="2026-09-07 03:58:17.238758515 +0000 UTC m=+44.894327055" Sep 07 03:58:17.262237 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.262190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" podStartSLOduration=12.443555907 podStartE2EDuration="21.262174905s" totalImagesPullingTime="8.818618998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:17.262017323 +0000 UTC m=+44.917585866" watchObservedRunningTime="2026-09-07 03:58:17.262174905 +0000 UTC m=+44.917743447" Sep 07 03:58:17.279068 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:17.279019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" podStartSLOduration=12.446057475 podStartE2EDuration="21.279005977s" totalImagesPullingTime="8.832948502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:17.277766293 +0000 UTC m=+44.933334838" watchObservedRunningTime="2026-09-07 03:58:17.279005977 +0000 UTC m=+44.934574522" Sep 07 03:58:22.660414 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:22.660374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:22.660414 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:22.660424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:22.660456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660535 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660559 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660558 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660629 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.660612616 +0000 UTC m=+66.316181137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660644 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.660638336 +0000 UTC m=+66.316206856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660648 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:22.660980 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:22.660749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:38.660727804 +0000 UTC m=+66.316296340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:32.141520 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:32.141489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gq5p9" Sep 07 03:58:38.676290 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:38.676290 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.676422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676495 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676523 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676503 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676576 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 03:59:10.676559061 +0000 UTC m=+98.332127587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676508 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 03:59:10.676585949 +0000 UTC m=+98.332154473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:58:38.676790 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.676645 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 03:59:10.676630333 +0000 UTC m=+98.332198853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:58:38.679081 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.679060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 03:58:38.679198 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.679182 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 03:58:38.679812 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.679787 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 03:58:38.686520 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.686497 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 03:58:38.686635 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:58:38.686547 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 03:59:42.686531602 +0000 UTC m=+130.342100123 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : secret "metrics-daemon-secret" not found Sep 07 03:58:38.688471 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.688444 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 03:58:38.689927 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.689906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87010d61-5656-4487-ab32-47577943ddf5-original-pull-secret\") pod \"global-pull-secret-syncer-q7bxz\" (UID: \"87010d61-5656-4487-ab32-47577943ddf5\") " pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:38.699643 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.699620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpvzn\" (UniqueName: \"kubernetes.io/projected/b4825a67-5eab-424f-ab28-89673cf69e2d-kube-api-access-qpvzn\") pod \"network-check-target-62s55\" (UID: \"b4825a67-5eab-424f-ab28-89673cf69e2d\") " pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:38.972117 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.972087 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrlx9\"" Sep 07 03:58:38.975098 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.975080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7bxz" Sep 07 03:58:38.979738 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:38.979723 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:39.253065 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:39.252983 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7bxz"] Sep 07 03:58:39.256327 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:39.256298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62s55"] Sep 07 03:58:39.256661 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:39.256632 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87010d61_5656_4487_ab32_47577943ddf5.slice/crio-10a4c7b5eb45e912f253b9048c47875c575e83f8d83829329e34f774213d10f4 WatchSource:0}: Error finding container 10a4c7b5eb45e912f253b9048c47875c575e83f8d83829329e34f774213d10f4: Status 404 returned error can't find the container with id 10a4c7b5eb45e912f253b9048c47875c575e83f8d83829329e34f774213d10f4 Sep 07 03:58:39.258968 ip-10-0-143-54 kubenswrapper[2579]: W0907 03:58:39.258938 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4825a67_5eab_424f_ab28_89673cf69e2d.slice/crio-6fbcc764d7ae3660abc953af008a1951acc6a1458d56440944ac46023dec1e61 WatchSource:0}: Error finding container 6fbcc764d7ae3660abc953af008a1951acc6a1458d56440944ac46023dec1e61: Status 404 returned error can't find the container with id 6fbcc764d7ae3660abc953af008a1951acc6a1458d56440944ac46023dec1e61 Sep 07 03:58:39.278160 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:39.278124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62s55" event={"ID":"b4825a67-5eab-424f-ab28-89673cf69e2d","Type":"ContainerStarted","Data":"6fbcc764d7ae3660abc953af008a1951acc6a1458d56440944ac46023dec1e61"} Sep 07 03:58:39.279286 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:39.279263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7bxz" event={"ID":"87010d61-5656-4487-ab32-47577943ddf5","Type":"ContainerStarted","Data":"10a4c7b5eb45e912f253b9048c47875c575e83f8d83829329e34f774213d10f4"} Sep 07 03:58:44.296478 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:44.296442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62s55" event={"ID":"b4825a67-5eab-424f-ab28-89673cf69e2d","Type":"ContainerStarted","Data":"6a42d13a4c656d787c6997ab64f5eec2be72627d5e9557d06c079549211cc21d"} Sep 07 03:58:44.296920 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:44.296541 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:58:44.297864 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:44.297843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7bxz" event={"ID":"87010d61-5656-4487-ab32-47577943ddf5","Type":"ContainerStarted","Data":"69989452fd80fa9a10fa48a562c2ba964158da819b7fc65d211c5c82fd75b14b"} Sep 07 03:58:44.312510 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:44.312460 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-62s55" podStartSLOduration=66.967964797 podStartE2EDuration="1m11.312443401s" totalImagesPullingTime="4.344478604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:44.311303059 +0000 UTC m=+71.966871622" watchObservedRunningTime="2026-09-07 03:58:44.312443401 +0000 UTC m=+71.968011977" Sep 07 03:58:44.324896 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:58:44.324856 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q7bxz" podStartSLOduration=66.975678028 podStartE2EDuration="1m11.324844316s" totalImagesPullingTime="4.349166288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:44.323937941 +0000 UTC m=+71.979506483" watchObservedRunningTime="2026-09-07 03:58:44.324844316 +0000 UTC m=+71.980412859" Sep 07 03:59:10.722634 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:59:10.722594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:59:10.722660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:59:10.722713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722781 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722826 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722874 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 04:00:14.722858242 +0000 UTC m=+162.378426764 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722894 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 04:00:14.72288458 +0000 UTC m=+162.378453101 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722782 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722908 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 03:59:10.723101 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:10.722937 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 04:00:14.722928528 +0000 UTC m=+162.378497055 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 03:59:15.303661 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:59:15.303622 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-62s55" Sep 07 03:59:42.758421 ip-10-0-143-54 kubenswrapper[2579]: I0907 03:59:42.758379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 03:59:42.758943 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:42.758517 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 03:59:42.758943 ip-10-0-143-54 kubenswrapper[2579]: E0907 03:59:42.758580 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 04:01:44.758566698 +0000 UTC m=+252.414135219 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : secret "metrics-daemon-secret" not found Sep 07 04:00:09.773089 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:09.773048 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" Sep 07 04:00:09.831384 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:09.831345 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" podUID="fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7" Sep 07 04:00:09.857686 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:09.857650 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dzjl7" podUID="aff9fd53-4913-4dc1-946d-bbc356ade55e" Sep 07 04:00:09.864835 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:09.864802 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 04:00:10.555557 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:10.555528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjl7" Sep 07 04:00:10.555737 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:10.555528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:00:14.805853 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:14.805809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:14.805868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:14.805901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.805974 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.805993 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479f6d85f-jhjx9: secret "image-registry-tls" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.805999 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.806071 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls podName:ae470757-4f60-4d27-8172-5a3e3a41ba20 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:16.806055513 +0000 UTC m=+284.461624052 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls") pod "image-registry-8479f6d85f-jhjx9" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20") : secret "image-registry-tls" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.806086 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert podName:fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:16.806079728 +0000 UTC m=+284.461648250 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-z6qqf" (UID: "fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7") : secret "networking-console-plugin-cert" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.806094 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 04:00:14.806330 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:00:14.806188 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls podName:aff9fd53-4913-4dc1-946d-bbc356ade55e nodeName:}" failed. No retries permitted until 2026-09-07 04:02:16.806166276 +0000 UTC m=+284.461734801 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls") pod "dns-default-dzjl7" (UID: "aff9fd53-4913-4dc1-946d-bbc356ade55e") : secret "dns-default-metrics-tls" not found Sep 07 04:00:16.574368 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.574333 2579 generic.go:356] "Generic (PLEG): container finished" podID="19441606-9e51-41af-b8bb-bd1902f098b1" containerID="90be60f3d264385d599a92ff850ee5f205fe8233430fb3f976e32ef73ffe62f7" exitCode=1 Sep 07 04:00:16.574837 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.574414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerDied","Data":"90be60f3d264385d599a92ff850ee5f205fe8233430fb3f976e32ef73ffe62f7"} Sep 07 04:00:16.574903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.574836 2579 scope.go:117] "RemoveContainer" containerID="90be60f3d264385d599a92ff850ee5f205fe8233430fb3f976e32ef73ffe62f7" Sep 07 04:00:16.575912 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.575890 2579 generic.go:356] "Generic (PLEG): container finished" podID="a982befc-13af-43de-b19d-d159d8765112" containerID="6b9c831981e670d1063dbc3f5af350bf991a4e6ea65a0c9819f03709cdcc769a" exitCode=255 Sep 07 04:00:16.576013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.575944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerDied","Data":"6b9c831981e670d1063dbc3f5af350bf991a4e6ea65a0c9819f03709cdcc769a"} Sep 07 04:00:16.576216 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:16.576203 2579 scope.go:117] "RemoveContainer" containerID="6b9c831981e670d1063dbc3f5af350bf991a4e6ea65a0c9819f03709cdcc769a" Sep 07 04:00:17.057694 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.057627 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 04:00:17.066784 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.066760 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:00:17.211198 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.211146 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:00:17.580496 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.580463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerStarted","Data":"d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c"} Sep 07 04:00:17.580970 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.580634 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:00:17.582053 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.582034 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:00:17.582338 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:17.582318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerStarted","Data":"bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1"} Sep 07 04:00:20.852615 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:20.852575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:00:23.851773 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:00:23.851734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 04:01:44.781844 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:44.781788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:01:44.782350 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:44.781958 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 04:01:44.782350 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:44.782038 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs podName:58775b98-3ad6-4949-8eea-804ce2783a3f nodeName:}" failed. No retries permitted until 2026-09-07 04:03:46.782020814 +0000 UTC m=+374.437589334 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs") pod "network-metrics-daemon-6hr6m" (UID: "58775b98-3ad6-4949-8eea-804ce2783a3f") : secret "metrics-daemon-secret" not found Sep 07 04:01:58.582346 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.582264 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ql7wd"] Sep 07 04:01:58.585123 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.585107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.587754 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.587701 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 04:01:58.587754 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.587736 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 04:01:58.587976 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.587850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9ddtk\"" Sep 07 04:01:58.588037 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.587972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 04:01:58.588099 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.588039 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 04:01:58.595003 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.594983 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ql7wd"] Sep 07 04:01:58.689630 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.689592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f72c41-a768-491d-9fe1-8593e1e77c58-data-volume\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.689819 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.689648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm77j\" (UniqueName: \"kubernetes.io/projected/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-api-access-zm77j\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.689819 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.689685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7f72c41-a768-491d-9fe1-8593e1e77c58-crio-socket\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.689819 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.689781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.689934 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.689849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790712 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f72c41-a768-491d-9fe1-8593e1e77c58-data-volume\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm77j\" (UniqueName: \"kubernetes.io/projected/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-api-access-zm77j\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7f72c41-a768-491d-9fe1-8593e1e77c58-crio-socket\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:58.790810 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:58.790882 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:01:58.790903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.790890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7f72c41-a768-491d-9fe1-8593e1e77c58-crio-socket\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.791232 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:58.790886 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:59.290868881 +0000 UTC m=+266.946437401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:01:58.791232 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:58.790948 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:59.290930312 +0000 UTC m=+266.946498839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : configmap "kube-rbac-proxy" not found Sep 07 04:01:58.791232 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.791104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7f72c41-a768-491d-9fe1-8593e1e77c58-data-volume\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:58.798869 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:58.798845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm77j\" (UniqueName: \"kubernetes.io/projected/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-api-access-zm77j\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:59.295953 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:59.295912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:59.296132 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:01:59.295979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:01:59.296132 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:59.296045 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:01:59.296132 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:59.296101 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:01:59.296132 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:59.296124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:00.296107181 +0000 UTC m=+267.951675702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : configmap "kube-rbac-proxy" not found Sep 07 04:01:59.296264 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:01:59.296140 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:00.296133847 +0000 UTC m=+267.951702368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:00.303411 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:00.303369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:00.303817 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:00.303436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:00.303817 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:00.303500 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:00.303817 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:00.303531 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:00.303817 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:00.303570 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:02.303552234 +0000 UTC m=+269.959120776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : configmap "kube-rbac-proxy" not found Sep 07 04:02:00.303817 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:00.303585 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:02.303578685 +0000 UTC m=+269.959147206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:00.368341 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:00.368312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5rz6f_6ebfbf69-5462-4af2-aedf-01685306f527/dns-node-resolver/0.log" Sep 07 04:02:01.569238 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:01.569212 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfz9w_0ad8ec9f-35dd-4028-b350-43bfb07a7a88/node-ca/0.log" Sep 07 04:02:02.320829 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:02.320743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:02.320829 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:02.320827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:02.321020 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:02.320898 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:02.321020 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:02.320945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:06.320932196 +0000 UTC m=+273.976500717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : configmap "kube-rbac-proxy" not found Sep 07 04:02:02.321020 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:02.320898 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:02.321119 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:02.321027 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:06.321012287 +0000 UTC m=+273.976580809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:02.369383 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:02.369352 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mt8sr_31370701-a241-4364-84cd-0551358f7870/serve-healthcheck-canary/0.log" Sep 07 04:02:06.354710 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:06.354659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:06.355089 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:06.354738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:06.355089 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:06.354784 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:06.355089 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:06.354844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:14.354829039 +0000 UTC m=+282.010397564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : configmap "kube-rbac-proxy" not found Sep 07 04:02:06.355089 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:06.354856 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:06.355089 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:06.354893 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:14.354882502 +0000 UTC m=+282.010451022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:13.556690 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:13.556643 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dzjl7" podUID="aff9fd53-4913-4dc1-946d-bbc356ade55e" Sep 07 04:02:13.557060 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:13.556644 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" Sep 07 04:02:13.913189 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:13.913106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:13.913189 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:13.913128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:14.417424 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:14.417387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:14.417629 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:14.417467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:14.417629 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:14.417548 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:14.417797 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:14.417643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls podName:d7f72c41-a768-491d-9fe1-8593e1e77c58 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:30.4176204 +0000 UTC m=+298.073188935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql7wd" (UID: "d7f72c41-a768-491d-9fe1-8593e1e77c58") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:14.417999 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:14.417980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7f72c41-a768-491d-9fe1-8593e1e77c58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:16.838032 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.837992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:16.838032 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.838038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:16.838506 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.838068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 04:02:16.840539 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.840507 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-z6qqf\" (UID: \"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 04:02:16.840539 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.840532 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"image-registry-8479f6d85f-jhjx9\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:16.840695 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.840518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff9fd53-4913-4dc1-946d-bbc356ade55e-metrics-tls\") pod \"dns-default-dzjl7\" (UID: \"aff9fd53-4913-4dc1-946d-bbc356ade55e\") " pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:16.917077 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.917040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dlnc5\"" Sep 07 04:02:16.917077 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.917041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9sb\"" Sep 07 04:02:16.923491 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.923467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:16.923654 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.923590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:16.924025 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.924004 2579 generic.go:356] "Generic (PLEG): container finished" podID="a982befc-13af-43de-b19d-d159d8765112" containerID="bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1" exitCode=255 Sep 07 04:02:16.924101 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.924082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerDied","Data":"bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1"} Sep 07 04:02:16.924156 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.924142 2579 scope.go:117] "RemoveContainer" containerID="6b9c831981e670d1063dbc3f5af350bf991a4e6ea65a0c9819f03709cdcc769a" Sep 07 04:02:16.924451 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.924435 2579 scope.go:117] "RemoveContainer" containerID="bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1" Sep 07 04:02:16.924632 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:16.924608 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-54b7b87644-7z96p_open-cluster-management-agent-addon(a982befc-13af-43de-b19d-d159d8765112)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" podUID="a982befc-13af-43de-b19d-d159d8765112" Sep 07 04:02:16.925895 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.925874 2579 generic.go:356] "Generic (PLEG): container finished" podID="19441606-9e51-41af-b8bb-bd1902f098b1" containerID="d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c" exitCode=1 Sep 07 04:02:16.925988 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.925924 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerDied","Data":"d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c"} Sep 07 04:02:16.926173 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.926154 2579 scope.go:117] "RemoveContainer" containerID="d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c" Sep 07 04:02:16.926300 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:16.926285 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-696855bb74-ssggt_open-cluster-management-agent-addon(19441606-9e51-41af-b8bb-bd1902f098b1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" podUID="19441606-9e51-41af-b8bb-bd1902f098b1" Sep 07 04:02:16.940244 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.940222 2579 scope.go:117] "RemoveContainer" containerID="90be60f3d264385d599a92ff850ee5f205fe8233430fb3f976e32ef73ffe62f7" Sep 07 04:02:16.954888 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.954859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c4swx\"" Sep 07 04:02:16.962994 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:16.962963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" Sep 07 04:02:17.057147 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.057113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" Sep 07 04:02:17.066264 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.066236 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:02:17.203929 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.203909 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzjl7"] Sep 07 04:02:17.206917 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.206889 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 04:02:17.207027 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:02:17.206963 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff9fd53_4913_4dc1_946d_bbc356ade55e.slice/crio-f3d4bb8b5f61e61649a8bc68d9b16b4f2791804c74d40aec4c5c6bd689335de5 WatchSource:0}: Error finding container f3d4bb8b5f61e61649a8bc68d9b16b4f2791804c74d40aec4c5c6bd689335de5: Status 404 returned error can't find the container with id f3d4bb8b5f61e61649a8bc68d9b16b4f2791804c74d40aec4c5c6bd689335de5 Sep 07 04:02:17.209542 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:02:17.209485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae470757_4f60_4d27_8172_5a3e3a41ba20.slice/crio-d739602a0635ed9613ed621d352facfe189dfc6ac5cec97fbf8bfabf82adc995 WatchSource:0}: Error finding container d739602a0635ed9613ed621d352facfe189dfc6ac5cec97fbf8bfabf82adc995: Status 404 returned error can't find the container with id d739602a0635ed9613ed621d352facfe189dfc6ac5cec97fbf8bfabf82adc995 Sep 07 04:02:17.239747 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.239721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-z6qqf"] Sep 07 04:02:17.580770 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.580735 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:02:17.932803 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.932721 2579 scope.go:117] "RemoveContainer" containerID="d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c" Sep 07 04:02:17.933234 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:17.932928 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-696855bb74-ssggt_open-cluster-management-agent-addon(19441606-9e51-41af-b8bb-bd1902f098b1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" podUID="19441606-9e51-41af-b8bb-bd1902f098b1" Sep 07 04:02:17.935116 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.935094 2579 scope.go:117] "RemoveContainer" containerID="bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1" Sep 07 04:02:17.935380 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:17.935314 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-54b7b87644-7z96p_open-cluster-management-agent-addon(a982befc-13af-43de-b19d-d159d8765112)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" podUID="a982befc-13af-43de-b19d-d159d8765112" Sep 07 04:02:17.936636 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.936578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" event={"ID":"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7","Type":"ContainerStarted","Data":"25f70ef8fc4d3c7e89205415214ea3908df5bfa7b8f8ab958c2ea7a38bd1f886"} Sep 07 04:02:17.938574 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.938531 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjl7" event={"ID":"aff9fd53-4913-4dc1-946d-bbc356ade55e","Type":"ContainerStarted","Data":"f3d4bb8b5f61e61649a8bc68d9b16b4f2791804c74d40aec4c5c6bd689335de5"} Sep 07 04:02:17.940425 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.940396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" event={"ID":"ae470757-4f60-4d27-8172-5a3e3a41ba20","Type":"ContainerStarted","Data":"e7566749a24d73e6f234feb78be9f2b47599ccb2de45d8a77f9c6756058879dc"} Sep 07 04:02:17.940527 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.940445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" event={"ID":"ae470757-4f60-4d27-8172-5a3e3a41ba20","Type":"ContainerStarted","Data":"d739602a0635ed9613ed621d352facfe189dfc6ac5cec97fbf8bfabf82adc995"} Sep 07 04:02:17.940647 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.940628 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:17.967008 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:17.966926 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" podStartSLOduration=284.966907734 podStartE2EDuration="4m44.966907734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:17.965913372 +0000 UTC m=+285.621481914" watchObservedRunningTime="2026-09-07 04:02:17.966907734 +0000 UTC m=+285.622476279" Sep 07 04:02:18.945596 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:18.945497 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" event={"ID":"fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7","Type":"ContainerStarted","Data":"28ad75db249a5f698b6cabdf0ef15e6e6e5fe81d794e170f78b131815789d28e"} Sep 07 04:02:18.946083 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:18.945847 2579 scope.go:117] "RemoveContainer" containerID="d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c" Sep 07 04:02:18.946083 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:18.946042 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-696855bb74-ssggt_open-cluster-management-agent-addon(19441606-9e51-41af-b8bb-bd1902f098b1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" podUID="19441606-9e51-41af-b8bb-bd1902f098b1" Sep 07 04:02:18.965500 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:18.965455 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-z6qqf" podStartSLOduration=261.666933623 podStartE2EDuration="4m22.965440472s" totalImagesPullingTime="1.298506849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:18.963990043 +0000 UTC m=+286.619558588" watchObservedRunningTime="2026-09-07 04:02:18.965440472 +0000 UTC m=+286.621009015" Sep 07 04:02:19.950002 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:19.949965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjl7" event={"ID":"aff9fd53-4913-4dc1-946d-bbc356ade55e","Type":"ContainerStarted","Data":"606c1d52688ce68c14ae30c2c02020a2473f086c7b254a575cd5e33deeca92da"} Sep 07 04:02:19.950457 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:19.950029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjl7" event={"ID":"aff9fd53-4913-4dc1-946d-bbc356ade55e","Type":"ContainerStarted","Data":"75574347b811ffbe036be536f592f5c5c34358e7a9d8981e2e095a010aebcfd6"} Sep 07 04:02:19.969369 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:19.969316 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dzjl7" podStartSLOduration=252.074681981 podStartE2EDuration="4m13.969298845s" totalImagesPullingTime="1.894616864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:19.967906513 +0000 UTC m=+287.623475066" watchObservedRunningTime="2026-09-07 04:02:19.969298845 +0000 UTC m=+287.624867388" Sep 07 04:02:20.953138 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:20.953108 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:23.853599 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:02:23.853556 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6hr6m" podUID="58775b98-3ad6-4949-8eea-804ce2783a3f" Sep 07 04:02:30.440879 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.440821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:30.443269 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.443243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7f72c41-a768-491d-9fe1-8593e1e77c58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql7wd\" (UID: \"d7f72c41-a768-491d-9fe1-8593e1e77c58\") " pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:30.694140 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.694037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ql7wd" Sep 07 04:02:30.958685 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.958650 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dzjl7" Sep 07 04:02:30.964382 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.964360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ql7wd"] Sep 07 04:02:30.965954 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:02:30.965931 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f72c41_a768_491d_9fe1_8593e1e77c58.slice/crio-15ad9329ac6e3f3d250b6ff8c01035d1d3de8180d86ce6a42f3bc95c9f322c99 WatchSource:0}: Error finding container 15ad9329ac6e3f3d250b6ff8c01035d1d3de8180d86ce6a42f3bc95c9f322c99: Status 404 returned error can't find the container with id 15ad9329ac6e3f3d250b6ff8c01035d1d3de8180d86ce6a42f3bc95c9f322c99 Sep 07 04:02:30.985630 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:30.985587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql7wd" event={"ID":"d7f72c41-a768-491d-9fe1-8593e1e77c58","Type":"ContainerStarted","Data":"15ad9329ac6e3f3d250b6ff8c01035d1d3de8180d86ce6a42f3bc95c9f322c99"} Sep 07 04:02:31.991038 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:31.990994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql7wd" event={"ID":"d7f72c41-a768-491d-9fe1-8593e1e77c58","Type":"ContainerStarted","Data":"527ea0fce48982211e8e9dadfe81227823c434c23a1d4494db5c1be2498e9f0e"} Sep 07 04:02:31.991473 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:31.991116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql7wd" event={"ID":"d7f72c41-a768-491d-9fe1-8593e1e77c58","Type":"ContainerStarted","Data":"3da8d88cd0c167ba3b782121e0bfd6f9f25be6406d782e9012e44fc9cf5b7fb3"} Sep 07 04:02:32.766144 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:32.766109 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 04:02:32.854410 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:32.854244 2579 scope.go:117] "RemoveContainer" containerID="bff16b72e7d51d25c663723904a01679a57398cf708dbe0ac7fc0a764906b2f1" Sep 07 04:02:32.997110 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:32.997075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7b87644-7z96p" event={"ID":"a982befc-13af-43de-b19d-d159d8765112","Type":"ContainerStarted","Data":"203afb9f4c4831526b18fb57056c06dec7f943191b012d24faefdfc9f99c663a"} Sep 07 04:02:33.852510 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:33.852483 2579 scope.go:117] "RemoveContainer" containerID="d86a21d3d4fce0975da2ef5127f1cfdb00722eb89945a218496f9700cdfa6b6c" Sep 07 04:02:34.002197 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:34.002158 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql7wd" event={"ID":"d7f72c41-a768-491d-9fe1-8593e1e77c58","Type":"ContainerStarted","Data":"82a64d5e70a76ca4a4d23818ba4932dc608b021b37c1582b019d5730798ec72b"} Sep 07 04:02:34.003902 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:34.003880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" event={"ID":"19441606-9e51-41af-b8bb-bd1902f098b1","Type":"ContainerStarted","Data":"b8392e7f12ab9359b98811d2f6927df78620760ce2f5e3cab7c6fbd3b3fa9871"} Sep 07 04:02:34.004141 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:34.004123 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:02:34.005460 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:34.005434 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696855bb74-ssggt" Sep 07 04:02:34.019090 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:34.019047 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ql7wd" podStartSLOduration=33.691207722 podStartE2EDuration="36.019034914s" totalImagesPullingTime="2.327827192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 04:01:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:34.018299351 +0000 UTC m=+301.673867916" watchObservedRunningTime="2026-09-07 04:02:34.019034914 +0000 UTC m=+301.674603457" Sep 07 04:02:35.852553 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:35.852506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:02:36.863962 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.863923 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cwmwg"] Sep 07 04:02:36.867403 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.867377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.870076 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.870049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qfk5d\"" Sep 07 04:02:36.870187 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.870165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 04:02:36.871157 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.871138 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 04:02:36.871269 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.871174 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 04:02:36.871269 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.871226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 04:02:36.871269 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.871231 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 04:02:36.871437 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.871230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 04:02:36.927972 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.927942 2579 patch_prober.go:28] interesting pod/image-registry-8479f6d85f-jhjx9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 04:02:36.928107 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.927991 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 04:02:36.991903 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.991856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-root\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.991943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.991973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-textfile\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.991994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-sys\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.992022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-wtmp\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.992040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8njvb\" (UniqueName: \"kubernetes.io/projected/ab15b173-5aee-4919-92aa-dfa26a53e5e3-kube-api-access-8njvb\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992210 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.992094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-tls\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992210 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.992123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-metrics-client-ca\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:36.992210 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:36.992143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.092935 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.092905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-tls\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.092935 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.092940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-metrics-client-ca\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093157 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.092960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093157 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.092988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-root\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093157 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-root\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093157 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093352 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-textfile\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093352 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-sys\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093352 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-wtmp\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093352 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8njvb\" (UniqueName: \"kubernetes.io/projected/ab15b173-5aee-4919-92aa-dfa26a53e5e3-kube-api-access-8njvb\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093352 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-sys\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093575 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093404 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-wtmp\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093630 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-metrics-client-ca\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093700 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093628 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.093769 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.093703 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-textfile\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.095483 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.095452 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-tls\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.095587 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.095551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab15b173-5aee-4919-92aa-dfa26a53e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.104304 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.104279 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8njvb\" (UniqueName: \"kubernetes.io/projected/ab15b173-5aee-4919-92aa-dfa26a53e5e3-kube-api-access-8njvb\") pod \"node-exporter-cwmwg\" (UID: \"ab15b173-5aee-4919-92aa-dfa26a53e5e3\") " pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.176711 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.176592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwmwg" Sep 07 04:02:37.187576 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:02:37.187551 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab15b173_5aee_4919_92aa_dfa26a53e5e3.slice/crio-82cbff514b2efb8709c613121e7b67255f504a30ddbdbe8eacd12ed1cefc4779 WatchSource:0}: Error finding container 82cbff514b2efb8709c613121e7b67255f504a30ddbdbe8eacd12ed1cefc4779: Status 404 returned error can't find the container with id 82cbff514b2efb8709c613121e7b67255f504a30ddbdbe8eacd12ed1cefc4779 Sep 07 04:02:37.189492 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:37.189472 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 04:02:38.018105 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:38.018063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwmwg" event={"ID":"ab15b173-5aee-4919-92aa-dfa26a53e5e3","Type":"ContainerStarted","Data":"82cbff514b2efb8709c613121e7b67255f504a30ddbdbe8eacd12ed1cefc4779"} Sep 07 04:02:38.949560 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:38.949531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:02:39.024016 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:39.023984 2579 generic.go:356] "Generic (PLEG): container finished" podID="ab15b173-5aee-4919-92aa-dfa26a53e5e3" containerID="5fc7e7bd2bb21a41bcfe79d24ff6ed0a7216748b90c98ba75d856d6838e1014a" exitCode=0 Sep 07 04:02:39.024387 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:39.024069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwmwg" event={"ID":"ab15b173-5aee-4919-92aa-dfa26a53e5e3","Type":"ContainerDied","Data":"5fc7e7bd2bb21a41bcfe79d24ff6ed0a7216748b90c98ba75d856d6838e1014a"} Sep 07 04:02:40.029972 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:40.029938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwmwg" event={"ID":"ab15b173-5aee-4919-92aa-dfa26a53e5e3","Type":"ContainerStarted","Data":"d0f61b234c841e10ae7372e99e6b56f02d73d687ec5cd2b52b797f13af5c1cd4"} Sep 07 04:02:40.030327 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:40.029987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwmwg" event={"ID":"ab15b173-5aee-4919-92aa-dfa26a53e5e3","Type":"ContainerStarted","Data":"07288411db8ec8acc501927a43ae9d2a3c33143793ebbb675b9ec2bb2e47d95f"} Sep 07 04:02:40.051141 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:40.051095 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cwmwg" podStartSLOduration=2.763433728 podStartE2EDuration="4.051081446s" totalImagesPullingTime="1.226291418s" totalInitContainerRuntime="61.3563ms" isStatefulPod=true podCreationTimestamp="2026-09-07 04:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:40.050868948 +0000 UTC m=+307.706437491" watchObservedRunningTime="2026-09-07 04:02:40.051081446 +0000 UTC m=+307.706649988" Sep 07 04:02:40.899555 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:02:40.899519 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 04:03:05.918559 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:05.918497 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerName="registry" containerID="cri-o://e7566749a24d73e6f234feb78be9f2b47599ccb2de45d8a77f9c6756058879dc" gracePeriod=30 Sep 07 04:03:06.117250 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.117211 2579 generic.go:356] "Generic (PLEG): container finished" podID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerID="e7566749a24d73e6f234feb78be9f2b47599ccb2de45d8a77f9c6756058879dc" exitCode=0 Sep 07 04:03:06.117401 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.117274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" event={"ID":"ae470757-4f60-4d27-8172-5a3e3a41ba20","Type":"ContainerDied","Data":"e7566749a24d73e6f234feb78be9f2b47599ccb2de45d8a77f9c6756058879dc"} Sep 07 04:03:06.150154 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.150130 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:03:06.326803 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.326770 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb8cx\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.326978 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.326833 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327049 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327103 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327072 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327147 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327099 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327147 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327142 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327293 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327168 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327568 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327501 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:03:06.327764 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327568 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted\") pod \"ae470757-4f60-4d27-8172-5a3e3a41ba20\" (UID: \"ae470757-4f60-4d27-8172-5a3e3a41ba20\") " Sep 07 04:03:06.327764 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327608 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:03:06.328064 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327829 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-certificates\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.328064 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.327848 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae470757-4f60-4d27-8172-5a3e3a41ba20-trusted-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.329428 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.329402 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx" (OuterVolumeSpecName: "kube-api-access-sb8cx") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "kube-api-access-sb8cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:03:06.329531 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.329422 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:03:06.329790 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.329764 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:03:06.329872 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.329827 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:03:06.330014 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.329998 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:03:06.336290 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.336265 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae470757-4f60-4d27-8172-5a3e3a41ba20" (UID: "ae470757-4f60-4d27-8172-5a3e3a41ba20"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:03:06.428498 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428459 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-registry-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.428498 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428490 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-image-registry-private-configuration\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.428498 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428501 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae470757-4f60-4d27-8172-5a3e3a41ba20-ca-trust-extracted\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.428745 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428510 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb8cx\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-kube-api-access-sb8cx\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.428745 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428519 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae470757-4f60-4d27-8172-5a3e3a41ba20-bound-sa-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:06.428745 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:06.428527 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae470757-4f60-4d27-8172-5a3e3a41ba20-installation-pull-secrets\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:03:07.090546 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.090508 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" podUID="5c1262da-6354-4c9c-aa89-92ce211fc6a2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 04:03:07.121826 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.121760 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" Sep 07 04:03:07.121964 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.121755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479f6d85f-jhjx9" event={"ID":"ae470757-4f60-4d27-8172-5a3e3a41ba20","Type":"ContainerDied","Data":"d739602a0635ed9613ed621d352facfe189dfc6ac5cec97fbf8bfabf82adc995"} Sep 07 04:03:07.121964 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.121894 2579 scope.go:117] "RemoveContainer" containerID="e7566749a24d73e6f234feb78be9f2b47599ccb2de45d8a77f9c6756058879dc" Sep 07 04:03:07.137634 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.137614 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 04:03:07.141415 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:07.141385 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8479f6d85f-jhjx9"] Sep 07 04:03:08.857047 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:08.857009 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" path="/var/lib/kubelet/pods/ae470757-4f60-4d27-8172-5a3e3a41ba20/volumes" Sep 07 04:03:17.090590 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:17.090549 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" podUID="5c1262da-6354-4c9c-aa89-92ce211fc6a2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 04:03:27.091182 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:27.091094 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" podUID="5c1262da-6354-4c9c-aa89-92ce211fc6a2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 04:03:27.091182 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:27.091178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" Sep 07 04:03:27.091744 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:27.091715 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"49699f862f2df934cf3e9c67e82b3eeadf276dc6331fdd84bede6a2399b0e46f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 07 04:03:27.091796 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:27.091768 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" podUID="5c1262da-6354-4c9c-aa89-92ce211fc6a2" containerName="service-proxy" containerID="cri-o://49699f862f2df934cf3e9c67e82b3eeadf276dc6331fdd84bede6a2399b0e46f" gracePeriod=30 Sep 07 04:03:28.190804 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:28.190761 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1262da-6354-4c9c-aa89-92ce211fc6a2" containerID="49699f862f2df934cf3e9c67e82b3eeadf276dc6331fdd84bede6a2399b0e46f" exitCode=2 Sep 07 04:03:28.191195 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:28.190820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerDied","Data":"49699f862f2df934cf3e9c67e82b3eeadf276dc6331fdd84bede6a2399b0e46f"} Sep 07 04:03:28.191195 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:28.190852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c45c8c7d-jj5kk" event={"ID":"5c1262da-6354-4c9c-aa89-92ce211fc6a2","Type":"ContainerStarted","Data":"f2b1e157ac902e6d31df9d9344e68503674e7597a1b5266e83256994f0e83dfb"} Sep 07 04:03:46.805320 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:46.805280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:03:46.807615 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:46.807577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58775b98-3ad6-4949-8eea-804ce2783a3f-metrics-certs\") pod \"network-metrics-daemon-6hr6m\" (UID: \"58775b98-3ad6-4949-8eea-804ce2783a3f\") " pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:03:46.956498 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:46.956466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbtcj\"" Sep 07 04:03:46.964566 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:46.964542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6hr6m" Sep 07 04:03:47.238549 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:47.238513 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6hr6m"] Sep 07 04:03:47.241411 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:03:47.241373 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58775b98_3ad6_4949_8eea_804ce2783a3f.slice/crio-9dad8c523d2ad692257b9419a2d2542105ebf4b5459d32c581a2404ba5ab242d WatchSource:0}: Error finding container 9dad8c523d2ad692257b9419a2d2542105ebf4b5459d32c581a2404ba5ab242d: Status 404 returned error can't find the container with id 9dad8c523d2ad692257b9419a2d2542105ebf4b5459d32c581a2404ba5ab242d Sep 07 04:03:47.260789 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:47.260749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6hr6m" event={"ID":"58775b98-3ad6-4949-8eea-804ce2783a3f","Type":"ContainerStarted","Data":"9dad8c523d2ad692257b9419a2d2542105ebf4b5459d32c581a2404ba5ab242d"} Sep 07 04:03:49.269014 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:49.268975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6hr6m" event={"ID":"58775b98-3ad6-4949-8eea-804ce2783a3f","Type":"ContainerStarted","Data":"998c597dfa52aea754f91c438cfcad4ba9865d6c1dddc33ac73d1653f9310b22"} Sep 07 04:03:49.269485 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:49.269028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6hr6m" event={"ID":"58775b98-3ad6-4949-8eea-804ce2783a3f","Type":"ContainerStarted","Data":"e51ec202764517d4222cc50bfdb6b2147534815bf433db1e1bf15522aa0f46b6"} Sep 07 04:03:49.285202 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:03:49.285146 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6hr6m" podStartSLOduration=375.333571885 podStartE2EDuration="6m16.285125452s" totalImagesPullingTime="951.553567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:03:49.283840469 +0000 UTC m=+376.939409012" watchObservedRunningTime="2026-09-07 04:03:49.285125452 +0000 UTC m=+376.940693997" Sep 07 04:06:34.026443 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.026355 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr"] Sep 07 04:06:34.026894 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.026645 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerName="registry" Sep 07 04:06:34.026894 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.026658 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerName="registry" Sep 07 04:06:34.026894 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.026723 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae470757-4f60-4d27-8172-5a3e3a41ba20" containerName="registry" Sep 07 04:06:34.029524 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.029507 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.032058 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.032031 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 07 04:06:34.033096 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.033077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 07 04:06:34.033191 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.033094 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sgpjj\"" Sep 07 04:06:34.037138 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.037113 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr"] Sep 07 04:06:34.146658 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.146617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.146847 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.146754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.146847 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.146786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5cw\" (UniqueName: \"kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.247238 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.247199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.247396 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.247244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5cw\" (UniqueName: \"kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.247396 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.247270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.247569 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.247552 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.247605 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.247583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.256124 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.256100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5cw\" (UniqueName: \"kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.339155 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.339053 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:06:34.616272 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.616188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr"] Sep 07 04:06:34.621017 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:34.620988 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7dafff_750c_4c1c_b1de_cda94efff212.slice/crio-1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590 WatchSource:0}: Error finding container 1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590: Status 404 returned error can't find the container with id 1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590 Sep 07 04:06:34.799990 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:34.799950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" event={"ID":"cd7dafff-750c-4c1c-b1de-cda94efff212","Type":"ContainerStarted","Data":"1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590"} Sep 07 04:06:35.049941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.049893 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v"] Sep 07 04:06:35.054227 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.054201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.062117 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.062091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v"] Sep 07 04:06:35.154349 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.154319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.154529 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.154377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcwb\" (UniqueName: \"kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.154529 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.154458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.255219 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.255177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcwb\" (UniqueName: \"kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.255395 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.255249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.255395 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.255294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.255771 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.255749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.255857 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.255771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.263987 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.263952 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcwb\" (UniqueName: \"kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.363930 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.363848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:06:35.413629 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.413585 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz"] Sep 07 04:06:35.417153 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.417128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.424987 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.424953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz"] Sep 07 04:06:35.456434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.456389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.456613 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.456518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rbt\" (UniqueName: \"kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.456613 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.456551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.515555 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.515520 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw"] Sep 07 04:06:35.518825 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.518797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.525614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.525548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw"] Sep 07 04:06:35.557877 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.557839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.558058 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.557912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445pp\" (UniqueName: \"kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.558058 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.557941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.558058 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.558013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rbt\" (UniqueName: \"kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.558207 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.558066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.558207 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.558092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.558469 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.558453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.558531 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.558500 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.566193 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.566163 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rbt\" (UniqueName: \"kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.614045 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.613969 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx"] Sep 07 04:06:35.617536 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.617509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.625792 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.625763 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx"] Sep 07 04:06:35.648330 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.648307 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v"] Sep 07 04:06:35.650996 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:35.650972 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbceffe5f_d7da_4364_aeae_2280c982c13b.slice/crio-e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b WatchSource:0}: Error finding container e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b: Status 404 returned error can't find the container with id e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b Sep 07 04:06:35.659342 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.659441 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445pp\" (UniqueName: \"kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.659441 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.659548 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pfmk\" (UniqueName: \"kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.659548 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.659617 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.659803 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.659852 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.659792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.667367 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.667342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-445pp\" (UniqueName: \"kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.716032 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.715992 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb"] Sep 07 04:06:35.719772 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.719745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.726600 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.726573 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb"] Sep 07 04:06:35.734433 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.734411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:06:35.760835 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.760798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pfmk\" (UniqueName: \"kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.761018 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.760853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.761018 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.760887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.761018 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.760924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.761192 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.761040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fxpq\" (UniqueName: \"kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.761192 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.761086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.761327 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.761308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.761383 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.761324 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.769888 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.769858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pfmk\" (UniqueName: \"kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:35.806420 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.806368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerStarted","Data":"e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b"} Sep 07 04:06:35.829640 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.829587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:06:35.862588 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.862497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fxpq\" (UniqueName: \"kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.862588 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.862546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.862588 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.862576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.863032 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.863009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.863137 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.863114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.872534 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.872430 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fxpq\" (UniqueName: \"kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:35.930013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:35.929967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:06:36.016348 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.016257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz"] Sep 07 04:06:36.021533 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:36.021489 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d68e9cd_b16a_4003_860e_740a979ea717.slice/crio-fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f WatchSource:0}: Error finding container fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f: Status 404 returned error can't find the container with id fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f Sep 07 04:06:36.033415 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.033388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:06:36.115891 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.115807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw"] Sep 07 04:06:36.116628 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:36.116593 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc49cf69_7e12_4b2a_aefe_b02696970f8b.slice/crio-e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57 WatchSource:0}: Error finding container e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57: Status 404 returned error can't find the container with id e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57 Sep 07 04:06:36.220960 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.217323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx"] Sep 07 04:06:36.221633 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:36.221580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080b2d9f_6809_484b_be55_57f237fd5316.slice/crio-141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249 WatchSource:0}: Error finding container 141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249: Status 404 returned error can't find the container with id 141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249 Sep 07 04:06:36.322292 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.322097 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb"] Sep 07 04:06:36.325347 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:36.325317 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfdecdf_8b80_4f47_9006_a77d6795877e.slice/crio-018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3 WatchSource:0}: Error finding container 018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3: Status 404 returned error can't find the container with id 018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3 Sep 07 04:06:36.815320 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.815220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerStarted","Data":"e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57"} Sep 07 04:06:36.817800 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.817718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" event={"ID":"9d68e9cd-b16a-4003-860e-740a979ea717","Type":"ContainerStarted","Data":"fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f"} Sep 07 04:06:36.819734 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.819654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" event={"ID":"7dfdecdf-8b80-4f47-9006-a77d6795877e","Type":"ContainerStarted","Data":"018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3"} Sep 07 04:06:36.821982 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:36.821916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerStarted","Data":"141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249"} Sep 07 04:06:37.897182 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.895808 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26"] Sep 07 04:06:37.900764 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.899405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.904614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.902752 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-xf9xn\"" Sep 07 04:06:37.904614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.903082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 07 04:06:37.904614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.903282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 04:06:37.904614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.903600 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 04:06:37.914167 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.912839 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26"] Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:37.986974 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:37.985774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgv2\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-kube-api-access-zjgv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgv2\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-kube-api-access-zjgv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087162 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.086963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087774 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.087363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087774 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.087614 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.087774 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.087726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.088024 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.087920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.088408 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.088381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.090355 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.090310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.100060 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.099750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.106988 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.106935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.113456 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.113333 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgv2\" (UniqueName: \"kubernetes.io/projected/ed801bd4-de89-47d5-9bfe-a4c450d5bc07-kube-api-access-zjgv2\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26\" (UID: \"ed801bd4-de89-47d5-9bfe-a4c450d5bc07\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.220441 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.220121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:38.542375 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.542219 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26"] Sep 07 04:06:38.559633 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:38.559585 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded801bd4_de89_47d5_9bfe_a4c450d5bc07.slice/crio-a62ad02ffed5f6006e78ebf8a5f4cd7e3db69210e4adce8b4dd3a27556592a98 WatchSource:0}: Error finding container a62ad02ffed5f6006e78ebf8a5f4cd7e3db69210e4adce8b4dd3a27556592a98: Status 404 returned error can't find the container with id a62ad02ffed5f6006e78ebf8a5f4cd7e3db69210e4adce8b4dd3a27556592a98 Sep 07 04:06:38.838008 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:38.837873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" event={"ID":"ed801bd4-de89-47d5-9bfe-a4c450d5bc07","Type":"ContainerStarted","Data":"a62ad02ffed5f6006e78ebf8a5f4cd7e3db69210e4adce8b4dd3a27556592a98"} Sep 07 04:06:45.299736 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.299659 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:06:45.300169 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.299787 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:06:45.300169 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.299832 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:06:45.884344 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.884253 2579 generic.go:356] "Generic (PLEG): container finished" podID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerID="cc36fccd7e2ade90c6a19961a05836a3bf2cd28d26020214c86d0968dae747c7" exitCode=0 Sep 07 04:06:45.884503 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.884352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerDied","Data":"cc36fccd7e2ade90c6a19961a05836a3bf2cd28d26020214c86d0968dae747c7"} Sep 07 04:06:45.885981 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.885953 2579 generic.go:356] "Generic (PLEG): container finished" podID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerID="9be322f2928ef115ad33e624050c48731768396878828daeb5b931b12a403789" exitCode=0 Sep 07 04:06:45.886067 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.886035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerDied","Data":"9be322f2928ef115ad33e624050c48731768396878828daeb5b931b12a403789"} Sep 07 04:06:45.887606 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.887585 2579 generic.go:356] "Generic (PLEG): container finished" podID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerID="03411618b76c15a1d0dba768c473dc5e9d6471d4967fe8328a51405c017015f3" exitCode=0 Sep 07 04:06:45.887702 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.887611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" event={"ID":"7dfdecdf-8b80-4f47-9006-a77d6795877e","Type":"ContainerDied","Data":"03411618b76c15a1d0dba768c473dc5e9d6471d4967fe8328a51405c017015f3"} Sep 07 04:06:45.889465 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.889444 2579 generic.go:356] "Generic (PLEG): container finished" podID="080b2d9f-6809-484b-be55-57f237fd5316" containerID="45de083ca2b73a3f282197716dd1370d8961c71fbce8a2c6bbb6ef864d94f490" exitCode=0 Sep 07 04:06:45.889552 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.889524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerDied","Data":"45de083ca2b73a3f282197716dd1370d8961c71fbce8a2c6bbb6ef864d94f490"} Sep 07 04:06:45.891270 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.891251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" event={"ID":"ed801bd4-de89-47d5-9bfe-a4c450d5bc07","Type":"ContainerStarted","Data":"2f9548ea0cdf44557c73fc0f21388276df0173479f79fcda8f64ae9e725ba999"} Sep 07 04:06:45.892993 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.892973 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d68e9cd-b16a-4003-860e-740a979ea717" containerID="2c53a19d097ce1caefa2b63b2554d8957d9ecdf9444fb3039b14e797b1fcd9e0" exitCode=0 Sep 07 04:06:45.893085 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.893030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" event={"ID":"9d68e9cd-b16a-4003-860e-740a979ea717","Type":"ContainerDied","Data":"2c53a19d097ce1caefa2b63b2554d8957d9ecdf9444fb3039b14e797b1fcd9e0"} Sep 07 04:06:45.894590 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.894546 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerID="e8d7115c705d3dfc23130e885d8b2728209e9f36a5b7f68403de1e3fb842f5f6" exitCode=0 Sep 07 04:06:45.894648 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.894600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" event={"ID":"cd7dafff-750c-4c1c-b1de-cda94efff212","Type":"ContainerDied","Data":"e8d7115c705d3dfc23130e885d8b2728209e9f36a5b7f68403de1e3fb842f5f6"} Sep 07 04:06:45.949021 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:45.948968 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" podStartSLOduration=2.214160953 podStartE2EDuration="8.948952632s" totalImagesPullingTime="6.734791679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:45.948453153 +0000 UTC m=+553.604021698" watchObservedRunningTime="2026-09-07 04:06:45.948952632 +0000 UTC m=+553.604521172" Sep 07 04:06:46.221345 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.221312 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:46.226110 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.226086 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:46.906376 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.906286 2579 generic.go:356] "Generic (PLEG): container finished" podID="080b2d9f-6809-484b-be55-57f237fd5316" containerID="011bdf00ed4bfa60ab6100a842df161b22575c8ef21866e8f077a9eafd36117b" exitCode=0 Sep 07 04:06:46.906902 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.906706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerDied","Data":"011bdf00ed4bfa60ab6100a842df161b22575c8ef21866e8f077a9eafd36117b"} Sep 07 04:06:46.907016 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.906997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:46.908698 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:46.908663 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26" Sep 07 04:06:47.915541 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:47.915502 2579 generic.go:356] "Generic (PLEG): container finished" podID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerID="8d4036677411f5a5e1a25b1ef3e3a33c3130543a118009b46aefcbe9a22a610d" exitCode=0 Sep 07 04:06:47.916026 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:47.915585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" event={"ID":"7dfdecdf-8b80-4f47-9006-a77d6795877e","Type":"ContainerDied","Data":"8d4036677411f5a5e1a25b1ef3e3a33c3130543a118009b46aefcbe9a22a610d"} Sep 07 04:06:47.918474 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:47.918288 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d68e9cd-b16a-4003-860e-740a979ea717" containerID="b52dbf6ad5093d56a07fd13e3096a2b24769cf3c94abdf2e19850150cd854990" exitCode=0 Sep 07 04:06:47.918474 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:47.918411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" event={"ID":"9d68e9cd-b16a-4003-860e-740a979ea717","Type":"ContainerDied","Data":"b52dbf6ad5093d56a07fd13e3096a2b24769cf3c94abdf2e19850150cd854990"} Sep 07 04:06:47.921173 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:47.921145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerStarted","Data":"c2e15447f0620f25cf34afb157d0182150fde2ab1304b61eb28fb2a8217776a0"} Sep 07 04:06:48.930568 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.930489 2579 generic.go:356] "Generic (PLEG): container finished" podID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerID="c2e15447f0620f25cf34afb157d0182150fde2ab1304b61eb28fb2a8217776a0" exitCode=0 Sep 07 04:06:48.931021 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.930650 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerDied","Data":"c2e15447f0620f25cf34afb157d0182150fde2ab1304b61eb28fb2a8217776a0"} Sep 07 04:06:48.936472 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.936445 2579 generic.go:356] "Generic (PLEG): container finished" podID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerID="27e81fffbd4af16ed5aa33bbbf02177b66a7e036ab69d374e0280ef771c5f5d9" exitCode=0 Sep 07 04:06:48.936629 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.936606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerDied","Data":"27e81fffbd4af16ed5aa33bbbf02177b66a7e036ab69d374e0280ef771c5f5d9"} Sep 07 04:06:48.940192 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.940165 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerID="ddf23fa87a4e832fd745f71fd7ff825504507463856b3b65fb7a083dfb468413" exitCode=0 Sep 07 04:06:48.941149 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:48.941123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" event={"ID":"cd7dafff-750c-4c1c-b1de-cda94efff212","Type":"ContainerDied","Data":"ddf23fa87a4e832fd745f71fd7ff825504507463856b3b65fb7a083dfb468413"} Sep 07 04:06:55.513728 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.511009 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj"] Sep 07 04:06:55.519762 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.519731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.524165 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.523928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-7fl4r\"" Sep 07 04:06:55.525097 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.524534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 04:06:55.525097 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.524823 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 07 04:06:55.531300 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.530480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 07 04:06:55.533397 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.533302 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 07 04:06:55.534547 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.534525 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj"] Sep 07 04:06:55.535150 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.534850 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.651699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.651780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.651815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.651837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.651899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlg4b\" (UniqueName: \"kubernetes.io/projected/f074f6cf-2ea7-45ff-8cca-26a637c39c74-kube-api-access-nlg4b\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.652125 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.652002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753320 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753558 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753558 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753558 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlg4b\" (UniqueName: \"kubernetes.io/projected/f074f6cf-2ea7-45ff-8cca-26a637c39c74-kube-api-access-nlg4b\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753558 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.753558 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.753468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.755292 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.754585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.757919 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.757866 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.758855 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.758812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.759555 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.759495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f074f6cf-2ea7-45ff-8cca-26a637c39c74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.760820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.760774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f074f6cf-2ea7-45ff-8cca-26a637c39c74-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.778126 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.777982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlg4b\" (UniqueName: \"kubernetes.io/projected/f074f6cf-2ea7-45ff-8cca-26a637c39c74-kube-api-access-nlg4b\") pod \"opendatahub-operator-controller-manager-74f7b546fd-2jszj\" (UID: \"f074f6cf-2ea7-45ff-8cca-26a637c39c74\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:55.837826 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:55.837573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:06:57.836480 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:57.836453 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj"] Sep 07 04:06:57.859605 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:06:57.859572 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf074f6cf_2ea7_45ff_8cca_26a637c39c74.slice/crio-312744ef05d156f96a3feab364c2d9cc60d03777851e69d1304bb9cb21abfe41 WatchSource:0}: Error finding container 312744ef05d156f96a3feab364c2d9cc60d03777851e69d1304bb9cb21abfe41: Status 404 returned error can't find the container with id 312744ef05d156f96a3feab364c2d9cc60d03777851e69d1304bb9cb21abfe41 Sep 07 04:06:58.000752 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:58.000701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerStarted","Data":"eae1d463a96f37232be4a1d27b1c11e488884e6a882fdee296b9e4bfc1670238"} Sep 07 04:06:58.003170 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:58.003142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerStarted","Data":"a629453b71201c59a459b91ea715cdccee2264264d40aa4e8f1023bbefb61c93"} Sep 07 04:06:58.004562 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:58.004535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" event={"ID":"f074f6cf-2ea7-45ff-8cca-26a637c39c74","Type":"ContainerStarted","Data":"312744ef05d156f96a3feab364c2d9cc60d03777851e69d1304bb9cb21abfe41"} Sep 07 04:06:58.020331 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:58.020280 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" podStartSLOduration=1.57884797 podStartE2EDuration="23.020263114s" totalImagesPullingTime="21.441415144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:58.020030924 +0000 UTC m=+565.675599477" watchObservedRunningTime="2026-09-07 04:06:58.020263114 +0000 UTC m=+565.675831692" Sep 07 04:06:58.048455 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:58.048402 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" podStartSLOduration=2.19048972 podStartE2EDuration="23.048380321s" totalImagesPullingTime="20.857890601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:58.047893704 +0000 UTC m=+565.703462247" watchObservedRunningTime="2026-09-07 04:06:58.048380321 +0000 UTC m=+565.703948875" Sep 07 04:06:59.014952 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.014770 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d68e9cd-b16a-4003-860e-740a979ea717" containerID="003ac4218177dd2747a47bfd90c10ff3e51e422101a15412e2c40517e9bfe994" exitCode=0 Sep 07 04:06:59.014952 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.014889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" event={"ID":"9d68e9cd-b16a-4003-860e-740a979ea717","Type":"ContainerDied","Data":"003ac4218177dd2747a47bfd90c10ff3e51e422101a15412e2c40517e9bfe994"} Sep 07 04:06:59.018510 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.018319 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerID="cd711007302833bfb2ec6fd582fc44ec81897cf1e5c3600eceacfe5bc98ba7f3" exitCode=0 Sep 07 04:06:59.018510 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.018434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" event={"ID":"cd7dafff-750c-4c1c-b1de-cda94efff212","Type":"ContainerDied","Data":"cd711007302833bfb2ec6fd582fc44ec81897cf1e5c3600eceacfe5bc98ba7f3"} Sep 07 04:06:59.021493 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.021458 2579 generic.go:356] "Generic (PLEG): container finished" podID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerID="a7b3e3e1a01b3fc7011e0db4a740baa98e1e6e44e5776c1cb18aebd3efd5482f" exitCode=0 Sep 07 04:06:59.021629 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.021505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerDied","Data":"a7b3e3e1a01b3fc7011e0db4a740baa98e1e6e44e5776c1cb18aebd3efd5482f"} Sep 07 04:06:59.024407 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.024378 2579 generic.go:356] "Generic (PLEG): container finished" podID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerID="eae1d463a96f37232be4a1d27b1c11e488884e6a882fdee296b9e4bfc1670238" exitCode=0 Sep 07 04:06:59.024530 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.024455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerDied","Data":"eae1d463a96f37232be4a1d27b1c11e488884e6a882fdee296b9e4bfc1670238"} Sep 07 04:06:59.027329 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.027300 2579 generic.go:356] "Generic (PLEG): container finished" podID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerID="4b0fb44066d8313663d9654220c214e848a44647c9e35ad97ccf7ad86201dff8" exitCode=0 Sep 07 04:06:59.027452 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.027390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" event={"ID":"7dfdecdf-8b80-4f47-9006-a77d6795877e","Type":"ContainerDied","Data":"4b0fb44066d8313663d9654220c214e848a44647c9e35ad97ccf7ad86201dff8"} Sep 07 04:06:59.030134 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.030042 2579 generic.go:356] "Generic (PLEG): container finished" podID="080b2d9f-6809-484b-be55-57f237fd5316" containerID="a629453b71201c59a459b91ea715cdccee2264264d40aa4e8f1023bbefb61c93" exitCode=0 Sep 07 04:06:59.030134 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:06:59.030094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerDied","Data":"a629453b71201c59a459b91ea715cdccee2264264d40aa4e8f1023bbefb61c93"} Sep 07 04:07:00.746477 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.746454 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:07:00.749559 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.749540 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:07:00.753267 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.753245 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:07:00.756539 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.756522 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:07:00.760050 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.760032 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:07:00.763004 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.762985 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:07:00.900331 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900289 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle\") pod \"bceffe5f-d7da-4364-aeae-2280c982c13b\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " Sep 07 04:07:00.900508 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900356 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftcwb\" (UniqueName: \"kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb\") pod \"bceffe5f-d7da-4364-aeae-2280c982c13b\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " Sep 07 04:07:00.900508 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900374 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util\") pod \"9d68e9cd-b16a-4003-860e-740a979ea717\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " Sep 07 04:07:00.900508 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900395 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle\") pod \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " Sep 07 04:07:00.900642 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900509 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-445pp\" (UniqueName: \"kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp\") pod \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " Sep 07 04:07:00.900642 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900547 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util\") pod \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\" (UID: \"cc49cf69-7e12-4b2a-aefe-b02696970f8b\") " Sep 07 04:07:00.900642 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900573 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle\") pod \"080b2d9f-6809-484b-be55-57f237fd5316\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " Sep 07 04:07:00.900642 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900601 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util\") pod \"7dfdecdf-8b80-4f47-9006-a77d6795877e\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " Sep 07 04:07:00.900642 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900638 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4rbt\" (UniqueName: \"kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt\") pod \"9d68e9cd-b16a-4003-860e-740a979ea717\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900694 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle\") pod \"9d68e9cd-b16a-4003-860e-740a979ea717\" (UID: \"9d68e9cd-b16a-4003-860e-740a979ea717\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900727 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle\") pod \"cd7dafff-750c-4c1c-b1de-cda94efff212\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900753 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pfmk\" (UniqueName: \"kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk\") pod \"080b2d9f-6809-484b-be55-57f237fd5316\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900777 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util\") pod \"080b2d9f-6809-484b-be55-57f237fd5316\" (UID: \"080b2d9f-6809-484b-be55-57f237fd5316\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900827 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle\") pod \"7dfdecdf-8b80-4f47-9006-a77d6795877e\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900876 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util\") pod \"cd7dafff-750c-4c1c-b1de-cda94efff212\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " Sep 07 04:07:00.900921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900899 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l5cw\" (UniqueName: \"kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw\") pod \"cd7dafff-750c-4c1c-b1de-cda94efff212\" (UID: \"cd7dafff-750c-4c1c-b1de-cda94efff212\") " Sep 07 04:07:00.901262 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900924 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fxpq\" (UniqueName: \"kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq\") pod \"7dfdecdf-8b80-4f47-9006-a77d6795877e\" (UID: \"7dfdecdf-8b80-4f47-9006-a77d6795877e\") " Sep 07 04:07:00.901262 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.900959 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util\") pod \"bceffe5f-d7da-4364-aeae-2280c982c13b\" (UID: \"bceffe5f-d7da-4364-aeae-2280c982c13b\") " Sep 07 04:07:00.901262 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.901170 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle" (OuterVolumeSpecName: "bundle") pod "cc49cf69-7e12-4b2a-aefe-b02696970f8b" (UID: "cc49cf69-7e12-4b2a-aefe-b02696970f8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.901469 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle" (OuterVolumeSpecName: "bundle") pod "bceffe5f-d7da-4364-aeae-2280c982c13b" (UID: "bceffe5f-d7da-4364-aeae-2280c982c13b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.901947 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle" (OuterVolumeSpecName: "bundle") pod "cd7dafff-750c-4c1c-b1de-cda94efff212" (UID: "cd7dafff-750c-4c1c-b1de-cda94efff212"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.902006 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle" (OuterVolumeSpecName: "bundle") pod "9d68e9cd-b16a-4003-860e-740a979ea717" (UID: "9d68e9cd-b16a-4003-860e-740a979ea717"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.902019 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle" (OuterVolumeSpecName: "bundle") pod "7dfdecdf-8b80-4f47-9006-a77d6795877e" (UID: "7dfdecdf-8b80-4f47-9006-a77d6795877e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.903857 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle" (OuterVolumeSpecName: "bundle") pod "080b2d9f-6809-484b-be55-57f237fd5316" (UID: "080b2d9f-6809-484b-be55-57f237fd5316"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.906581 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util" (OuterVolumeSpecName: "util") pod "9d68e9cd-b16a-4003-860e-740a979ea717" (UID: "9d68e9cd-b16a-4003-860e-740a979ea717"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.907858 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.907785 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util" (OuterVolumeSpecName: "util") pod "bceffe5f-d7da-4364-aeae-2280c982c13b" (UID: "bceffe5f-d7da-4364-aeae-2280c982c13b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.909757 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.909714 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util" (OuterVolumeSpecName: "util") pod "080b2d9f-6809-484b-be55-57f237fd5316" (UID: "080b2d9f-6809-484b-be55-57f237fd5316"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.910070 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.909982 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp" (OuterVolumeSpecName: "kube-api-access-445pp") pod "cc49cf69-7e12-4b2a-aefe-b02696970f8b" (UID: "cc49cf69-7e12-4b2a-aefe-b02696970f8b"). InnerVolumeSpecName "kube-api-access-445pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:00.910070 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910024 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk" (OuterVolumeSpecName: "kube-api-access-7pfmk") pod "080b2d9f-6809-484b-be55-57f237fd5316" (UID: "080b2d9f-6809-484b-be55-57f237fd5316"). InnerVolumeSpecName "kube-api-access-7pfmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:00.910070 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910031 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt" (OuterVolumeSpecName: "kube-api-access-r4rbt") pod "9d68e9cd-b16a-4003-860e-740a979ea717" (UID: "9d68e9cd-b16a-4003-860e-740a979ea717"). InnerVolumeSpecName "kube-api-access-r4rbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:00.910070 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910048 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb" (OuterVolumeSpecName: "kube-api-access-ftcwb") pod "bceffe5f-d7da-4364-aeae-2280c982c13b" (UID: "bceffe5f-d7da-4364-aeae-2280c982c13b"). InnerVolumeSpecName "kube-api-access-ftcwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:00.910361 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910337 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util" (OuterVolumeSpecName: "util") pod "cc49cf69-7e12-4b2a-aefe-b02696970f8b" (UID: "cc49cf69-7e12-4b2a-aefe-b02696970f8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.910443 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910357 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq" (OuterVolumeSpecName: "kube-api-access-8fxpq") pod "7dfdecdf-8b80-4f47-9006-a77d6795877e" (UID: "7dfdecdf-8b80-4f47-9006-a77d6795877e"). InnerVolumeSpecName "kube-api-access-8fxpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:00.910443 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.910384 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util" (OuterVolumeSpecName: "util") pod "7dfdecdf-8b80-4f47-9006-a77d6795877e" (UID: "7dfdecdf-8b80-4f47-9006-a77d6795877e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.911931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.911905 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util" (OuterVolumeSpecName: "util") pod "cd7dafff-750c-4c1c-b1de-cda94efff212" (UID: "cd7dafff-750c-4c1c-b1de-cda94efff212"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:07:00.912009 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:00.911975 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw" (OuterVolumeSpecName: "kube-api-access-4l5cw") pod "cd7dafff-750c-4c1c-b1de-cda94efff212" (UID: "cd7dafff-750c-4c1c-b1de-cda94efff212"). InnerVolumeSpecName "kube-api-access-4l5cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.001918 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.001959 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l5cw\" (UniqueName: \"kubernetes.io/projected/cd7dafff-750c-4c1c-b1de-cda94efff212-kube-api-access-4l5cw\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.001976 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fxpq\" (UniqueName: \"kubernetes.io/projected/7dfdecdf-8b80-4f47-9006-a77d6795877e-kube-api-access-8fxpq\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.001990 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002002 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bceffe5f-d7da-4364-aeae-2280c982c13b-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002013 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002015 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftcwb\" (UniqueName: \"kubernetes.io/projected/bceffe5f-d7da-4364-aeae-2280c982c13b-kube-api-access-ftcwb\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002027 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002043 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002058 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-445pp\" (UniqueName: \"kubernetes.io/projected/cc49cf69-7e12-4b2a-aefe-b02696970f8b-kube-api-access-445pp\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002071 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc49cf69-7e12-4b2a-aefe-b02696970f8b-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002085 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002098 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002112 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4rbt\" (UniqueName: \"kubernetes.io/projected/9d68e9cd-b16a-4003-860e-740a979ea717-kube-api-access-r4rbt\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002126 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d68e9cd-b16a-4003-860e-740a979ea717-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002145 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd7dafff-750c-4c1c-b1de-cda94efff212-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002165 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pfmk\" (UniqueName: \"kubernetes.io/projected/080b2d9f-6809-484b-be55-57f237fd5316-kube-api-access-7pfmk\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002186 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/080b2d9f-6809-484b-be55-57f237fd5316-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.002434 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.002202 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dfdecdf-8b80-4f47-9006-a77d6795877e-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:01.040255 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.040220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" event={"ID":"bceffe5f-d7da-4364-aeae-2280c982c13b","Type":"ContainerDied","Data":"e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b"} Sep 07 04:07:01.040381 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.040273 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7b29b0fc4f29ad2c210610d824ff33bece51fcae2548124adf4078497f51c7b" Sep 07 04:07:01.040381 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.040237 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c4p8v" Sep 07 04:07:01.042301 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.042283 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" Sep 07 04:07:01.042301 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.042288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053cm9nb" event={"ID":"7dfdecdf-8b80-4f47-9006-a77d6795877e","Type":"ContainerDied","Data":"018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3"} Sep 07 04:07:01.042477 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.042325 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="018bec40d0932c647d3caf2e0f18a73e3bf1633af36d26193fd9075b637686d3" Sep 07 04:07:01.044193 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.044164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" event={"ID":"080b2d9f-6809-484b-be55-57f237fd5316","Type":"ContainerDied","Data":"141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249"} Sep 07 04:07:01.044289 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.044199 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="141fe10c7a109c2309a3eb59a231b46ab1d5598de1ab2367f274780a419c7249" Sep 07 04:07:01.044289 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.044169 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a06mvlx" Sep 07 04:07:01.046171 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.046148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" event={"ID":"f074f6cf-2ea7-45ff-8cca-26a637c39c74","Type":"ContainerStarted","Data":"7494e0415efc8312ccb0b31ae89bf84efcc8c481de435ce266c45be83ac6c606"} Sep 07 04:07:01.048307 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.048285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" event={"ID":"9d68e9cd-b16a-4003-860e-740a979ea717","Type":"ContainerDied","Data":"fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f"} Sep 07 04:07:01.048413 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.048329 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc53427efebd0e0c2ad18438187822d731b3a33e1ec38bf9b4b2cbd1c5a54e4f" Sep 07 04:07:01.048413 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.048297 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbgtqzz" Sep 07 04:07:01.050845 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.050707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" event={"ID":"cd7dafff-750c-4c1c-b1de-cda94efff212","Type":"ContainerDied","Data":"1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590"} Sep 07 04:07:01.050845 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.050717 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecd9xr" Sep 07 04:07:01.050845 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.050745 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e231c54aa6404ae02edd0f7e7eee433e59d2125cfbefaa53061c4f3dff17590" Sep 07 04:07:01.053212 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.053192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" event={"ID":"cc49cf69-7e12-4b2a-aefe-b02696970f8b","Type":"ContainerDied","Data":"e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57"} Sep 07 04:07:01.053325 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.053227 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74b980ff85d42e1be5777efafbef227b63571e55c1c9ee7d9dd3e9e265b3b57" Sep 07 04:07:01.053325 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:01.053240 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ck2vqw" Sep 07 04:07:02.059979 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:02.059944 2579 generic.go:356] "Generic (PLEG): container finished" podID="f074f6cf-2ea7-45ff-8cca-26a637c39c74" containerID="7494e0415efc8312ccb0b31ae89bf84efcc8c481de435ce266c45be83ac6c606" exitCode=0 Sep 07 04:07:02.060373 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:02.060033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" event={"ID":"f074f6cf-2ea7-45ff-8cca-26a637c39c74","Type":"ContainerDied","Data":"7494e0415efc8312ccb0b31ae89bf84efcc8c481de435ce266c45be83ac6c606"} Sep 07 04:07:03.065893 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:03.065857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" event={"ID":"f074f6cf-2ea7-45ff-8cca-26a637c39c74","Type":"ContainerStarted","Data":"25ee4465e2d8a8f949fed3dbed84d37eb5746df5342e8704f12bf32c1359c0d9"} Sep 07 04:07:03.066267 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:03.065973 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:07:03.089882 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:03.089829 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" podStartSLOduration=4.387671093 podStartE2EDuration="8.089812344s" totalImagesPullingTime="3.186079657s" totalInitContainerRuntime="516.061594ms" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:03.08783484 +0000 UTC m=+570.743403396" watchObservedRunningTime="2026-09-07 04:07:03.089812344 +0000 UTC m=+570.745380887" Sep 07 04:07:06.839528 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839489 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk"] Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839739 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839750 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839764 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839769 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839776 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839781 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839787 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839791 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839799 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839804 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839814 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839819 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839825 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839830 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839838 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839842 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839847 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839852 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839859 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839863 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839869 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839873 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839878 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839883 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839889 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839894 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="extract" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839900 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839905 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839910 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839915 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839920 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839925 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839932 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839937 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="util" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839942 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="pull" Sep 07 04:07:06.839931 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839948 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="pull" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839989 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfdecdf-8b80-4f47-9006-a77d6795877e" containerName="extract" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.839996 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d68e9cd-b16a-4003-860e-740a979ea717" containerName="extract" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.840003 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bceffe5f-d7da-4364-aeae-2280c982c13b" containerName="extract" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.840008 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc49cf69-7e12-4b2a-aefe-b02696970f8b" containerName="extract" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.840013 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="080b2d9f-6809-484b-be55-57f237fd5316" containerName="extract" Sep 07 04:07:06.840950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.840018 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd7dafff-750c-4c1c-b1de-cda94efff212" containerName="extract" Sep 07 04:07:06.874914 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.874873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:06.877864 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.877837 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 04:07:06.878854 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.878823 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-cn5kk\"" Sep 07 04:07:06.878971 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.878826 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 04:07:06.880699 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:06.880661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk"] Sep 07 04:07:07.046979 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.046932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74821336-d4ad-4a40-9889-5ac066020961-tmp\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.047153 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.047008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59jw\" (UniqueName: \"kubernetes.io/projected/74821336-d4ad-4a40-9889-5ac066020961-kube-api-access-t59jw\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.147784 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.147653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74821336-d4ad-4a40-9889-5ac066020961-tmp\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.147784 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.147740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59jw\" (UniqueName: \"kubernetes.io/projected/74821336-d4ad-4a40-9889-5ac066020961-kube-api-access-t59jw\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.148092 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.148072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74821336-d4ad-4a40-9889-5ac066020961-tmp\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.155533 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.155512 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59jw\" (UniqueName: \"kubernetes.io/projected/74821336-d4ad-4a40-9889-5ac066020961-kube-api-access-t59jw\") pod \"jobset-operator-56d489b4b8-kgstk\" (UID: \"74821336-d4ad-4a40-9889-5ac066020961\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.184557 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.184521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" Sep 07 04:07:07.474106 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:07.474069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk"] Sep 07 04:07:07.476332 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:07.476303 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74821336_d4ad_4a40_9889_5ac066020961.slice/crio-5583a1cc1c3626efce62dfc86061447edeec93d1c53503a12346346fdf90ab35 WatchSource:0}: Error finding container 5583a1cc1c3626efce62dfc86061447edeec93d1c53503a12346346fdf90ab35: Status 404 returned error can't find the container with id 5583a1cc1c3626efce62dfc86061447edeec93d1c53503a12346346fdf90ab35 Sep 07 04:07:08.087562 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:08.087522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" event={"ID":"74821336-d4ad-4a40-9889-5ac066020961","Type":"ContainerStarted","Data":"5583a1cc1c3626efce62dfc86061447edeec93d1c53503a12346346fdf90ab35"} Sep 07 04:07:14.072617 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:14.072587 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-2jszj" Sep 07 04:07:19.137051 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:19.137016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" event={"ID":"74821336-d4ad-4a40-9889-5ac066020961","Type":"ContainerStarted","Data":"f61b8af7e645eb0f944a06322c46af1f4b59bf4cf13422cb8315dd5d5246efb8"} Sep 07 04:07:19.154066 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:19.154019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-kgstk" podStartSLOduration=2.4383066749999998 podStartE2EDuration="13.15400482s" totalImagesPullingTime="10.715698145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:19.153251438 +0000 UTC m=+586.808820009" watchObservedRunningTime="2026-09-07 04:07:19.15400482 +0000 UTC m=+586.809573363" Sep 07 04:07:23.393890 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.393849 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r"] Sep 07 04:07:23.396143 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.396125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:23.398697 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.398651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 07 04:07:23.398697 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.398690 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 07 04:07:23.399735 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.399718 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9wk78\"" Sep 07 04:07:23.405465 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.405435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r"] Sep 07 04:07:23.463834 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.463794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrf7m\" (UniqueName: \"kubernetes.io/projected/f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a-kube-api-access-nrf7m\") pod \"limitador-operator-controller-manager-565895c755-xfr2r\" (UID: \"f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:23.564400 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.564364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrf7m\" (UniqueName: \"kubernetes.io/projected/f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a-kube-api-access-nrf7m\") pod \"limitador-operator-controller-manager-565895c755-xfr2r\" (UID: \"f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:23.579425 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.579390 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrf7m\" (UniqueName: \"kubernetes.io/projected/f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a-kube-api-access-nrf7m\") pod \"limitador-operator-controller-manager-565895c755-xfr2r\" (UID: \"f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:23.707707 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.707655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:23.981881 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:23.981858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r"] Sep 07 04:07:23.984410 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:23.984380 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cfdcb7_d926_4e03_95cb_9d4340d4ad8a.slice/crio-a1eb538735651def96a4059926d5da2e394c75a5d6b6774df836e1b1f767024d WatchSource:0}: Error finding container a1eb538735651def96a4059926d5da2e394c75a5d6b6774df836e1b1f767024d: Status 404 returned error can't find the container with id a1eb538735651def96a4059926d5da2e394c75a5d6b6774df836e1b1f767024d Sep 07 04:07:24.161319 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:24.161279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" event={"ID":"f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a","Type":"ContainerStarted","Data":"a1eb538735651def96a4059926d5da2e394c75a5d6b6774df836e1b1f767024d"} Sep 07 04:07:27.177617 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.177580 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" event={"ID":"f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a","Type":"ContainerStarted","Data":"fce7ec3a99cdbbc0f1edf3dd5c31fc67d43c62547d3f59b12e40994bdc7af39f"} Sep 07 04:07:27.177994 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.177711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:27.194440 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.194390 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" podStartSLOduration=1.699150685 podStartE2EDuration="4.19437461s" totalImagesPullingTime="2.495223925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:27.192905532 +0000 UTC m=+594.848474074" watchObservedRunningTime="2026-09-07 04:07:27.19437461 +0000 UTC m=+594.849943152" Sep 07 04:07:27.913798 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.913758 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-d84qb"] Sep 07 04:07:27.915629 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.915611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:27.923360 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.923341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jzqpq\"" Sep 07 04:07:27.943222 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.943193 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-d84qb"] Sep 07 04:07:27.999632 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:27.999596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qgt\" (UniqueName: \"kubernetes.io/projected/4f851eb7-49a1-4d00-8972-4b32b0d2390c-kube-api-access-82qgt\") pod \"authorino-operator-84d9bfc694-d84qb\" (UID: \"4f851eb7-49a1-4d00-8972-4b32b0d2390c\") " pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:28.100834 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:28.100799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qgt\" (UniqueName: \"kubernetes.io/projected/4f851eb7-49a1-4d00-8972-4b32b0d2390c-kube-api-access-82qgt\") pod \"authorino-operator-84d9bfc694-d84qb\" (UID: \"4f851eb7-49a1-4d00-8972-4b32b0d2390c\") " pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:28.110941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:28.110908 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qgt\" (UniqueName: \"kubernetes.io/projected/4f851eb7-49a1-4d00-8972-4b32b0d2390c-kube-api-access-82qgt\") pod \"authorino-operator-84d9bfc694-d84qb\" (UID: \"4f851eb7-49a1-4d00-8972-4b32b0d2390c\") " pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:28.225012 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:28.224981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:28.500739 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:28.498507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-d84qb"] Sep 07 04:07:28.517025 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:28.516987 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f851eb7_49a1_4d00_8972_4b32b0d2390c.slice/crio-eb039f69cc6590d501dc30042eb012b1d27f3bf6ac5419b3e7544d319ab50494 WatchSource:0}: Error finding container eb039f69cc6590d501dc30042eb012b1d27f3bf6ac5419b3e7544d319ab50494: Status 404 returned error can't find the container with id eb039f69cc6590d501dc30042eb012b1d27f3bf6ac5419b3e7544d319ab50494 Sep 07 04:07:29.187544 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:29.187508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" event={"ID":"4f851eb7-49a1-4d00-8972-4b32b0d2390c","Type":"ContainerStarted","Data":"eb039f69cc6590d501dc30042eb012b1d27f3bf6ac5419b3e7544d319ab50494"} Sep 07 04:07:31.198268 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:31.198232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" event={"ID":"4f851eb7-49a1-4d00-8972-4b32b0d2390c","Type":"ContainerStarted","Data":"74c58310fc220497129d35c838d9ef9551301a45e2717745d4b97dc22cbd2af1"} Sep 07 04:07:31.198778 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:31.198369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:31.214990 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:31.214939 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" podStartSLOduration=2.330217748 podStartE2EDuration="4.21492338s" totalImagesPullingTime="1.884705632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:31.214014582 +0000 UTC m=+598.869583125" watchObservedRunningTime="2026-09-07 04:07:31.21492338 +0000 UTC m=+598.870491923" Sep 07 04:07:33.842192 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.842149 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt"] Sep 07 04:07:33.844178 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.844159 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:33.846820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.846800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-928zk\"" Sep 07 04:07:33.855842 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.855810 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt"] Sep 07 04:07:33.955747 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.955708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bnz\" (UniqueName: \"kubernetes.io/projected/3586f194-5c46-4385-8783-f2c3573cdb4a-kube-api-access-88bnz\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:33.955939 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:33.955759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3586f194-5c46-4385-8783-f2c3573cdb4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.056522 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.056481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bnz\" (UniqueName: \"kubernetes.io/projected/3586f194-5c46-4385-8783-f2c3573cdb4a-kube-api-access-88bnz\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.056522 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.056525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3586f194-5c46-4385-8783-f2c3573cdb4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.056907 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.056887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3586f194-5c46-4385-8783-f2c3573cdb4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.064606 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.064584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bnz\" (UniqueName: \"kubernetes.io/projected/3586f194-5c46-4385-8783-f2c3573cdb4a-kube-api-access-88bnz\") pod \"kuadrant-operator-controller-manager-7456d9997c-5hgzt\" (UID: \"3586f194-5c46-4385-8783-f2c3573cdb4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.154271 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.154170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:34.430172 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:34.430142 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt"] Sep 07 04:07:34.432585 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:34.432550 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3586f194_5c46_4385_8783_f2c3573cdb4a.slice/crio-503f764ec8a9d7f5b6f3512e99e42c812070650f237366a6534c70b546001b5e WatchSource:0}: Error finding container 503f764ec8a9d7f5b6f3512e99e42c812070650f237366a6534c70b546001b5e: Status 404 returned error can't find the container with id 503f764ec8a9d7f5b6f3512e99e42c812070650f237366a6534c70b546001b5e Sep 07 04:07:35.218508 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:35.218474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" event={"ID":"3586f194-5c46-4385-8783-f2c3573cdb4a","Type":"ContainerStarted","Data":"503f764ec8a9d7f5b6f3512e99e42c812070650f237366a6534c70b546001b5e"} Sep 07 04:07:37.471502 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.471468 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr"] Sep 07 04:07:37.473839 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.473812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.476323 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.476302 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m6f8d\"" Sep 07 04:07:37.488884 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.488858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr"] Sep 07 04:07:37.583846 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.583806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg582\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-kube-api-access-rg582\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.583846 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.583848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584068 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.583921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584068 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.583969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584068 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.583999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584068 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.584025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584191 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.584082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584191 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.584097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.584191 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.584117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685490 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685490 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg582\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-kube-api-access-rg582\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.685820 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.686213 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.686213 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.685998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.686213 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.686021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.686213 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.686202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.686569 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.686552 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.688046 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.688022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.688274 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.688257 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.693528 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.693495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg582\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-kube-api-access-rg582\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.693870 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.693851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr\" (UID: \"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:37.784007 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:37.783918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:38.069432 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.069406 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr"] Sep 07 04:07:38.070122 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:38.070094 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfa7c88_fcd4_4a0e_84b4_51e236ab00ed.slice/crio-81ade348d94273eb9d1c91a9a8c6508745dc0e21c47157fb5f2d71061d66cd18 WatchSource:0}: Error finding container 81ade348d94273eb9d1c91a9a8c6508745dc0e21c47157fb5f2d71061d66cd18: Status 404 returned error can't find the container with id 81ade348d94273eb9d1c91a9a8c6508745dc0e21c47157fb5f2d71061d66cd18 Sep 07 04:07:38.072258 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.072223 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:07:38.072345 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.072326 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:07:38.072409 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.072375 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:07:38.183441 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.183404 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-xfr2r" Sep 07 04:07:38.235298 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.235264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" event={"ID":"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed","Type":"ContainerStarted","Data":"2439a244ff0cede39817b9a4e67b8c97bba0ebf235da4d8ebf6772fbd5542119"} Sep 07 04:07:38.235551 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.235324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" event={"ID":"ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed","Type":"ContainerStarted","Data":"81ade348d94273eb9d1c91a9a8c6508745dc0e21c47157fb5f2d71061d66cd18"} Sep 07 04:07:38.253717 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.253685 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-89nlk"] Sep 07 04:07:38.256782 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.256667 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" podStartSLOduration=1.256640283 podStartE2EDuration="1.256640283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:38.254591465 +0000 UTC m=+605.910160010" watchObservedRunningTime="2026-09-07 04:07:38.256640283 +0000 UTC m=+605.912208843" Sep 07 04:07:38.257017 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.256998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.259420 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.259382 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 07 04:07:38.259618 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.259603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 07 04:07:38.259911 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.259889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 07 04:07:38.259992 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.259891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9rwj8\"" Sep 07 04:07:38.266143 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.266118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-89nlk"] Sep 07 04:07:38.290798 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.290751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d155d5-6413-46c2-af6b-967f117e5199-data\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.290972 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.290804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn6nt\" (UniqueName: \"kubernetes.io/projected/e9d155d5-6413-46c2-af6b-967f117e5199-kube-api-access-vn6nt\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.391944 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.391850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d155d5-6413-46c2-af6b-967f117e5199-data\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.391944 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.391890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn6nt\" (UniqueName: \"kubernetes.io/projected/e9d155d5-6413-46c2-af6b-967f117e5199-kube-api-access-vn6nt\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.392242 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.392222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d155d5-6413-46c2-af6b-967f117e5199-data\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.399485 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.399463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn6nt\" (UniqueName: \"kubernetes.io/projected/e9d155d5-6413-46c2-af6b-967f117e5199-kube-api-access-vn6nt\") pod \"postgres-69fb4594cf-89nlk\" (UID: \"e9d155d5-6413-46c2-af6b-967f117e5199\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.434557 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.434524 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn"] Sep 07 04:07:38.436750 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.436731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.439455 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.439432 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 04:07:38.439455 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.439444 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-dd6l9\"" Sep 07 04:07:38.439455 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.439453 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 04:07:38.444739 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.444715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Sep 07 04:07:38.447334 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.447309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn"] Sep 07 04:07:38.492348 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.492304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p92rb\" (UniqueName: \"kubernetes.io/projected/f4c0e73b-7271-457d-9eb6-62d2aeafe521-kube-api-access-p92rb\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.492348 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.492346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c0e73b-7271-457d-9eb6-62d2aeafe521-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.492831 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.492421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-manifests\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.492831 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.492494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-tmp\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.569335 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.569299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:38.593451 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.593401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c0e73b-7271-457d-9eb6-62d2aeafe521-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.593616 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.593504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-manifests\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.593616 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.593549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-tmp\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.593763 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.593614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p92rb\" (UniqueName: \"kubernetes.io/projected/f4c0e73b-7271-457d-9eb6-62d2aeafe521-kube-api-access-p92rb\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.594099 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.594051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-tmp\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.594212 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.594111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4c0e73b-7271-457d-9eb6-62d2aeafe521-manifests\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.594660 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.594638 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c0e73b-7271-457d-9eb6-62d2aeafe521-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.602333 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.602304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p92rb\" (UniqueName: \"kubernetes.io/projected/f4c0e73b-7271-457d-9eb6-62d2aeafe521-kube-api-access-p92rb\") pod \"kserve-module-controller-manager-54765d59fd-m7nwn\" (UID: \"f4c0e73b-7271-457d-9eb6-62d2aeafe521\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.747884 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.747842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:38.784852 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.784808 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:38.840763 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.840664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-89nlk"] Sep 07 04:07:38.842425 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:38.842388 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d155d5_6413_46c2_af6b_967f117e5199.slice/crio-db0150a1c0152e78a72de102a33ec049ee7169287db7319fdc5d1a3fce766908 WatchSource:0}: Error finding container db0150a1c0152e78a72de102a33ec049ee7169287db7319fdc5d1a3fce766908: Status 404 returned error can't find the container with id db0150a1c0152e78a72de102a33ec049ee7169287db7319fdc5d1a3fce766908 Sep 07 04:07:38.844208 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:38.844189 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 04:07:39.019946 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:39.019880 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn"] Sep 07 04:07:39.023655 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:39.023615 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c0e73b_7271_457d_9eb6_62d2aeafe521.slice/crio-199793c2db14edf8f842a827e37de4bd5d26136f0132060d084778507a4800cc WatchSource:0}: Error finding container 199793c2db14edf8f842a827e37de4bd5d26136f0132060d084778507a4800cc: Status 404 returned error can't find the container with id 199793c2db14edf8f842a827e37de4bd5d26136f0132060d084778507a4800cc Sep 07 04:07:39.241438 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:39.241400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" event={"ID":"e9d155d5-6413-46c2-af6b-967f117e5199","Type":"ContainerStarted","Data":"db0150a1c0152e78a72de102a33ec049ee7169287db7319fdc5d1a3fce766908"} Sep 07 04:07:39.242590 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:39.242565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" event={"ID":"f4c0e73b-7271-457d-9eb6-62d2aeafe521","Type":"ContainerStarted","Data":"199793c2db14edf8f842a827e37de4bd5d26136f0132060d084778507a4800cc"} Sep 07 04:07:39.790834 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:39.790800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:40.249466 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:40.249427 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:40.250602 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:40.250578 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr" Sep 07 04:07:41.257690 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:41.257635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" event={"ID":"f4c0e73b-7271-457d-9eb6-62d2aeafe521","Type":"ContainerStarted","Data":"3750680a9f725a6e1f5e58f5885f575e8c2557b3269bb7b170595d255878d8f9"} Sep 07 04:07:41.258168 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:41.258088 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:07:41.275847 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:41.275782 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" podStartSLOduration=1.475502904 podStartE2EDuration="3.27576358s" totalImagesPullingTime="1.800260676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:41.274298095 +0000 UTC m=+608.929866639" watchObservedRunningTime="2026-09-07 04:07:41.27576358 +0000 UTC m=+608.931332122" Sep 07 04:07:42.205726 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:42.205690 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-d84qb" Sep 07 04:07:45.283616 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:45.283577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" event={"ID":"3586f194-5c46-4385-8783-f2c3573cdb4a","Type":"ContainerStarted","Data":"18698da2a7c41be158d227673a195cc62b826081b842d4a63c57d174ccf38056"} Sep 07 04:07:45.284097 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:45.283685 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:45.311570 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:45.311509 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" podStartSLOduration=1.846711193 podStartE2EDuration="12.311487409s" totalImagesPullingTime="10.464776216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:45.307657699 +0000 UTC m=+612.963226254" watchObservedRunningTime="2026-09-07 04:07:45.311487409 +0000 UTC m=+612.967055979" Sep 07 04:07:46.290219 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:46.290180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" event={"ID":"e9d155d5-6413-46c2-af6b-967f117e5199","Type":"ContainerStarted","Data":"c6d7b09dba4b1e65134b9d34ebba577e25289cf9c02d4d451d8656ba5f925c45"} Sep 07 04:07:46.290699 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:46.290453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:46.306317 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:46.306262 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" podStartSLOduration=1.071831956 podStartE2EDuration="8.306243744s" totalImagesPullingTime="7.234411788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:46.304859913 +0000 UTC m=+613.960428456" watchObservedRunningTime="2026-09-07 04:07:46.306243744 +0000 UTC m=+613.961812319" Sep 07 04:07:48.162941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.162905 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:48.167420 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.167395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:48.170082 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.170049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5zvg7\"" Sep 07 04:07:48.176044 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.176021 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:48.283190 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.283148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tx95\" (UniqueName: \"kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95\") pod \"authorino-b54df94b4-98brl\" (UID: \"4d20ebb7-ec85-49c1-adb2-477ebd5958d2\") " pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:48.384088 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.384051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tx95\" (UniqueName: \"kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95\") pod \"authorino-b54df94b4-98brl\" (UID: \"4d20ebb7-ec85-49c1-adb2-477ebd5958d2\") " pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:48.393322 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.393289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tx95\" (UniqueName: \"kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95\") pod \"authorino-b54df94b4-98brl\" (UID: \"4d20ebb7-ec85-49c1-adb2-477ebd5958d2\") " pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:48.479255 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.479219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:48.753073 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:48.753047 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:48.755258 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:48.755233 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d20ebb7_ec85_49c1_adb2_477ebd5958d2.slice/crio-704cd9521aad4b937dc9f7e27a506ab805e783f8b42bc6749de10c4c5dfd1043 WatchSource:0}: Error finding container 704cd9521aad4b937dc9f7e27a506ab805e783f8b42bc6749de10c4c5dfd1043: Status 404 returned error can't find the container with id 704cd9521aad4b937dc9f7e27a506ab805e783f8b42bc6749de10c4c5dfd1043 Sep 07 04:07:49.304445 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:49.304406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-98brl" event={"ID":"4d20ebb7-ec85-49c1-adb2-477ebd5958d2","Type":"ContainerStarted","Data":"704cd9521aad4b937dc9f7e27a506ab805e783f8b42bc6749de10c4c5dfd1043"} Sep 07 04:07:51.316081 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:51.316046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-98brl" event={"ID":"4d20ebb7-ec85-49c1-adb2-477ebd5958d2","Type":"ContainerStarted","Data":"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832"} Sep 07 04:07:51.343075 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:51.343019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-98brl" podStartSLOduration=1.259971428 podStartE2EDuration="3.343003679s" totalImagesPullingTime="2.083032251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:51.340832467 +0000 UTC m=+618.996401009" watchObservedRunningTime="2026-09-07 04:07:51.343003679 +0000 UTC m=+618.998572276" Sep 07 04:07:52.325197 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:52.325169 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-89nlk" Sep 07 04:07:54.291369 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.291327 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:54.291779 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.291480 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-98brl" podUID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" containerName="authorino" containerID="cri-o://223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832" gracePeriod=30 Sep 07 04:07:54.541588 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.541528 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:54.633785 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.633743 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tx95\" (UniqueName: \"kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95\") pod \"4d20ebb7-ec85-49c1-adb2-477ebd5958d2\" (UID: \"4d20ebb7-ec85-49c1-adb2-477ebd5958d2\") " Sep 07 04:07:54.635934 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.635906 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95" (OuterVolumeSpecName: "kube-api-access-5tx95") pod "4d20ebb7-ec85-49c1-adb2-477ebd5958d2" (UID: "4d20ebb7-ec85-49c1-adb2-477ebd5958d2"). InnerVolumeSpecName "kube-api-access-5tx95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:07:54.734303 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:54.734263 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tx95\" (UniqueName: \"kubernetes.io/projected/4d20ebb7-ec85-49c1-adb2-477ebd5958d2-kube-api-access-5tx95\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\"" Sep 07 04:07:55.336221 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.336185 2579 generic.go:356] "Generic (PLEG): container finished" podID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" containerID="223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832" exitCode=0 Sep 07 04:07:55.336635 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.336248 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-98brl" Sep 07 04:07:55.336635 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.336274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-98brl" event={"ID":"4d20ebb7-ec85-49c1-adb2-477ebd5958d2","Type":"ContainerDied","Data":"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832"} Sep 07 04:07:55.336635 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.336324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-98brl" event={"ID":"4d20ebb7-ec85-49c1-adb2-477ebd5958d2","Type":"ContainerDied","Data":"704cd9521aad4b937dc9f7e27a506ab805e783f8b42bc6749de10c4c5dfd1043"} Sep 07 04:07:55.336635 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.336343 2579 scope.go:117] "RemoveContainer" containerID="223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832" Sep 07 04:07:55.344663 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.344641 2579 scope.go:117] "RemoveContainer" containerID="223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832" Sep 07 04:07:55.344961 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:07:55.344941 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832\": container with ID starting with 223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832 not found: ID does not exist" containerID="223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832" Sep 07 04:07:55.345007 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.344970 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832"} err="failed to get container status \"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832\": rpc error: code = NotFound desc = could not find container \"223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832\": container with ID starting with 223558cc996e3f05b08f87d729ccb9a9d2806a7d55baf8a689c1a55683baa832 not found: ID does not exist" Sep 07 04:07:55.351502 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.351471 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:55.353228 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:55.353211 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-98brl"] Sep 07 04:07:56.293251 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:56.293218 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-5hgzt" Sep 07 04:07:56.857856 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:56.857815 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" path="/var/lib/kubelet/pods/4d20ebb7-ec85-49c1-adb2-477ebd5958d2/volumes" Sep 07 04:07:57.322856 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.322825 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b6fdbb89f-s9bzb"] Sep 07 04:07:57.323127 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.323115 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" containerName="authorino" Sep 07 04:07:57.323178 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.323129 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" containerName="authorino" Sep 07 04:07:57.323217 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.323193 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d20ebb7-ec85-49c1-adb2-477ebd5958d2" containerName="authorino" Sep 07 04:07:57.326155 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.326135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.330396 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.330375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 07 04:07:57.330523 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.330380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 07 04:07:57.330591 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.330529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pxj4q\"" Sep 07 04:07:57.331135 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.331119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 07 04:07:57.339012 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.338990 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b6fdbb89f-s9bzb"] Sep 07 04:07:57.458446 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.458405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.458597 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.458457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-metrics-certs\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.458597 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.458477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbzx\" (UniqueName: \"kubernetes.io/projected/9c43c3bf-0b50-4fc6-803c-4effe57405c4-kube-api-access-gwbzx\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.559930 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.559885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.560091 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.559942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-metrics-certs\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.560091 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.559959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbzx\" (UniqueName: \"kubernetes.io/projected/9c43c3bf-0b50-4fc6-803c-4effe57405c4-kube-api-access-gwbzx\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.560091 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:07:57.560049 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 07 04:07:57.560228 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:07:57.560120 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert podName:9c43c3bf-0b50-4fc6-803c-4effe57405c4 nodeName:}" failed. No retries permitted until 2026-09-07 04:07:58.060102281 +0000 UTC m=+625.715670803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert") pod "maas-controller-7b6fdbb89f-s9bzb" (UID: "9c43c3bf-0b50-4fc6-803c-4effe57405c4") : secret "maas-controller-webhook-cert" not found Sep 07 04:07:57.562320 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.562291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-metrics-certs\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:57.576251 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:57.576186 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbzx\" (UniqueName: \"kubernetes.io/projected/9c43c3bf-0b50-4fc6-803c-4effe57405c4-kube-api-access-gwbzx\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:58.064062 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:58.064022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:58.066527 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:58.066495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c43c3bf-0b50-4fc6-803c-4effe57405c4-webhook-cert\") pod \"maas-controller-7b6fdbb89f-s9bzb\" (UID: \"9c43c3bf-0b50-4fc6-803c-4effe57405c4\") " pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:58.236143 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:58.236104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:07:58.507062 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:58.506985 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b6fdbb89f-s9bzb"] Sep 07 04:07:58.509171 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:07:58.509144 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c43c3bf_0b50_4fc6_803c_4effe57405c4.slice/crio-816cb1e7319a4c75107dd9062077ec7eb9d6767ae9070106d83030c37632d7bd WatchSource:0}: Error finding container 816cb1e7319a4c75107dd9062077ec7eb9d6767ae9070106d83030c37632d7bd: Status 404 returned error can't find the container with id 816cb1e7319a4c75107dd9062077ec7eb9d6767ae9070106d83030c37632d7bd Sep 07 04:07:59.359424 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:07:59.359381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" event={"ID":"9c43c3bf-0b50-4fc6-803c-4effe57405c4","Type":"ContainerStarted","Data":"816cb1e7319a4c75107dd9062077ec7eb9d6767ae9070106d83030c37632d7bd"} Sep 07 04:08:00.365410 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:00.365315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" event={"ID":"9c43c3bf-0b50-4fc6-803c-4effe57405c4","Type":"ContainerStarted","Data":"67ef7a55fd516feb245e3ca165e5fd7e24e1c34db343bf74e1901b17a8c83d08"} Sep 07 04:08:00.365808 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:00.365420 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:08:00.407817 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:00.407752 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" podStartSLOduration=1.9138179690000001 podStartE2EDuration="3.407734533s" totalImagesPullingTime="1.493916564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:00.394213332 +0000 UTC m=+628.049781874" watchObservedRunningTime="2026-09-07 04:08:00.407734533 +0000 UTC m=+628.063303075" Sep 07 04:08:02.266343 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:02.266310 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-m7nwn" Sep 07 04:08:11.373499 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:11.373463 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b6fdbb89f-s9bzb" Sep 07 04:08:29.716734 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.716702 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-2qvxg"] Sep 07 04:08:29.719626 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.719603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.722034 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.722011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 07 04:08:29.722034 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.722024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6qdt8\"" Sep 07 04:08:29.729315 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.729292 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-2qvxg"] Sep 07 04:08:29.735727 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.735703 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-qvr6m"] Sep 07 04:08:29.738336 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.738316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.740691 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.740657 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 07 04:08:29.740795 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.740703 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 07 04:08:29.740958 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.740935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-27dqm\"" Sep 07 04:08:29.748068 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.748045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-qvr6m"] Sep 07 04:08:29.830290 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.830255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.830459 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.830327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjxv\" (UniqueName: \"kubernetes.io/projected/de09b934-9bd6-418d-ab34-0927ab4c2f56-kube-api-access-mhjxv\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.830459 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.830349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.830459 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.830365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.830459 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.830394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x244g\" (UniqueName: \"kubernetes.io/projected/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-kube-api-access-x244g\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.903178 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.903142 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm"] Sep 07 04:08:29.912029 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.912001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:29.915278 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.915250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 07 04:08:29.915412 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.915312 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 07 04:08:29.915412 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.915363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j28qj\"" Sep 07 04:08:29.915508 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.915500 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 07 04:08:29.917908 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.917887 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm"] Sep 07 04:08:29.931433 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.931401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x244g\" (UniqueName: \"kubernetes.io/projected/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-kube-api-access-x244g\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.931567 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.931481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.931649 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.931612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjxv\" (UniqueName: \"kubernetes.io/projected/de09b934-9bd6-418d-ab34-0927ab4c2f56-kube-api-access-mhjxv\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.931649 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.931639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:29.931778 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.931662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.931869 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.931850 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 07 04:08:29.931925 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.931914 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs podName:d2c427ff-be39-4026-b2a1-7ccd07cdf4c2 nodeName:}" failed. No retries permitted until 2026-09-07 04:08:30.431894754 +0000 UTC m=+658.087463292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs") pod "model-serving-api-7d6487fcc8-2qvxg" (UID: "d2c427ff-be39-4026-b2a1-7ccd07cdf4c2") : secret "model-serving-api-tls" not found Sep 07 04:08:29.932575 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.932548 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-metrics-tls: secret "odh-model-controller-metrics-tls" not found Sep 07 04:08:29.932839 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.932610 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs podName:de09b934-9bd6-418d-ab34-0927ab4c2f56 nodeName:}" failed. No retries permitted until 2026-09-07 04:08:30.4325935 +0000 UTC m=+658.088162038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs") pod "odh-model-controller-bb7b75cc4-qvr6m" (UID: "de09b934-9bd6-418d-ab34-0927ab4c2f56") : secret "odh-model-controller-metrics-tls" not found Sep 07 04:08:29.932839 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.932739 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 07 04:08:29.932839 ip-10-0-143-54 kubenswrapper[2579]: E0907 04:08:29.932805 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert podName:de09b934-9bd6-418d-ab34-0927ab4c2f56 nodeName:}" failed. No retries permitted until 2026-09-07 04:08:30.432788597 +0000 UTC m=+658.088357134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert") pod "odh-model-controller-bb7b75cc4-qvr6m" (UID: "de09b934-9bd6-418d-ab34-0927ab4c2f56") : secret "odh-model-controller-webhook-cert" not found Sep 07 04:08:29.943063 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.943041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x244g\" (UniqueName: \"kubernetes.io/projected/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-kube-api-access-x244g\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:29.943063 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:29.943060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjxv\" (UniqueName: \"kubernetes.io/projected/de09b934-9bd6-418d-ab34-0927ab4c2f56-kube-api-access-mhjxv\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.033007 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.032915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033007 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.032956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033199 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.033019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqss8\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-kube-api-access-kqss8\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033199 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.033054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033199 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.033073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb903e9-001f-4625-b068-a1b89e9bf916-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033199 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.033092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.033199 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.033109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134233 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134423 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134423 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134423 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134594 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqss8\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-kube-api-access-kqss8\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134594 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.134777 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.134726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb903e9-001f-4625-b068-a1b89e9bf916-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.135060 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.135035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.137008 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.136974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.137123 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.136987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.137266 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.137247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.137630 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.137604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb903e9-001f-4625-b068-a1b89e9bf916-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.142266 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.142241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqss8\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-kube-api-access-kqss8\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.142364 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.142328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb903e9-001f-4625-b068-a1b89e9bf916-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sd7wm\" (UID: \"1fb903e9-001f-4625-b068-a1b89e9bf916\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.223169 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.223136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:30.438092 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.437999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.438092 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.438044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:30.438092 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.438094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.440538 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.440502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.440538 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.440530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c427ff-be39-4026-b2a1-7ccd07cdf4c2-tls-certs\") pod \"model-serving-api-7d6487fcc8-2qvxg\" (UID: \"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2\") " pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:30.440741 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.440577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de09b934-9bd6-418d-ab34-0927ab4c2f56-cert\") pod \"odh-model-controller-bb7b75cc4-qvr6m\" (UID: \"de09b934-9bd6-418d-ab34-0927ab4c2f56\") " pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.508896 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.508869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm"] Sep 07 04:08:30.511306 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:08:30.511276 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb903e9_001f_4625_b068_a1b89e9bf916.slice/crio-4ecd94d36d0b34669f63ad177b0c7291f483aa57381aa1f698957365e138cb2f WatchSource:0}: Error finding container 4ecd94d36d0b34669f63ad177b0c7291f483aa57381aa1f698957365e138cb2f: Status 404 returned error can't find the container with id 4ecd94d36d0b34669f63ad177b0c7291f483aa57381aa1f698957365e138cb2f Sep 07 04:08:30.630792 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.630759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:30.652815 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.652779 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:30.903996 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.903966 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-2qvxg"] Sep 07 04:08:30.905204 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:08:30.905173 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c427ff_be39_4026_b2a1_7ccd07cdf4c2.slice/crio-beedef4cb344017d847081090e967c302cee095f880d8df068e6884c2ec3c8a8 WatchSource:0}: Error finding container beedef4cb344017d847081090e967c302cee095f880d8df068e6884c2ec3c8a8: Status 404 returned error can't find the container with id beedef4cb344017d847081090e967c302cee095f880d8df068e6884c2ec3c8a8 Sep 07 04:08:30.932169 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:30.932145 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-qvr6m"] Sep 07 04:08:30.933188 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:08:30.933162 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde09b934_9bd6_418d_ab34_0927ab4c2f56.slice/crio-6186987c64af0b9e6a5a7e1ad37171b12c19b5c81f1f5488dcea0848a3e55e32 WatchSource:0}: Error finding container 6186987c64af0b9e6a5a7e1ad37171b12c19b5c81f1f5488dcea0848a3e55e32: Status 404 returned error can't find the container with id 6186987c64af0b9e6a5a7e1ad37171b12c19b5c81f1f5488dcea0848a3e55e32 Sep 07 04:08:31.521875 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:31.521837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" event={"ID":"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2","Type":"ContainerStarted","Data":"beedef4cb344017d847081090e967c302cee095f880d8df068e6884c2ec3c8a8"} Sep 07 04:08:31.524861 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:31.524782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" event={"ID":"de09b934-9bd6-418d-ab34-0927ab4c2f56","Type":"ContainerStarted","Data":"6186987c64af0b9e6a5a7e1ad37171b12c19b5c81f1f5488dcea0848a3e55e32"} Sep 07 04:08:31.527628 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:31.527565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" event={"ID":"1fb903e9-001f-4625-b068-a1b89e9bf916","Type":"ContainerStarted","Data":"4ecd94d36d0b34669f63ad177b0c7291f483aa57381aa1f698957365e138cb2f"} Sep 07 04:08:34.920596 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:34.920559 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:08:34.921064 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:34.920635 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 07 04:08:35.557186 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.557146 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" event={"ID":"de09b934-9bd6-418d-ab34-0927ab4c2f56","Type":"ContainerStarted","Data":"768ec2591331a1f76063d505bcaa82da0f9c44af6cec90c7d2bcf451b79c6b27"} Sep 07 04:08:35.557357 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.557213 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:35.558569 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.558540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" event={"ID":"1fb903e9-001f-4625-b068-a1b89e9bf916","Type":"ContainerStarted","Data":"b12a1b68c6cdb83a0bcc7a9cab0b63e46f9135deee8e3bb66566d4e75cdd59e0"} Sep 07 04:08:35.558711 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.558590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:35.559921 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.559897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" event={"ID":"d2c427ff-be39-4026-b2a1-7ccd07cdf4c2","Type":"ContainerStarted","Data":"fc8b5f7d568d0abaa3d8676d700dea74cface844df8213a523473e73fd86629a"} Sep 07 04:08:35.560051 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.560035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:08:35.573911 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.573865 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" podStartSLOduration=2.587905599 podStartE2EDuration="6.57385079s" totalImagesPullingTime="3.985945191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:35.571952887 +0000 UTC m=+663.227521449" watchObservedRunningTime="2026-09-07 04:08:35.57385079 +0000 UTC m=+663.229419357" Sep 07 04:08:35.587010 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.586958 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" podStartSLOduration=2.579463247 podStartE2EDuration="6.586934024s" totalImagesPullingTime="4.007470777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:35.586502947 +0000 UTC m=+663.242071502" watchObservedRunningTime="2026-09-07 04:08:35.586934024 +0000 UTC m=+663.242502578" Sep 07 04:08:35.608056 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:35.607997 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" podStartSLOduration=2.200832164 podStartE2EDuration="6.60797643s" totalImagesPullingTime="4.407144266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:35.607907745 +0000 UTC m=+663.263476288" watchObservedRunningTime="2026-09-07 04:08:35.60797643 +0000 UTC m=+663.263544973" Sep 07 04:08:36.567081 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:36.567045 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sd7wm" Sep 07 04:08:46.567328 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:46.567294 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-bb7b75cc4-qvr6m" Sep 07 04:08:46.569168 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:08:46.569148 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-7d6487fcc8-2qvxg" Sep 07 04:18:24.866793 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:24.866752 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-m7nwn_f4c0e73b-7271-457d-9eb6-62d2aeafe521/manager/0.log" Sep 07 04:18:25.100022 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:25.099943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b6fdbb89f-s9bzb_9c43c3bf-0b50-4fc6-803c-4effe57405c4/manager/0.log" Sep 07 04:18:25.215771 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:25.215749 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-2qvxg_d2c427ff-be39-4026-b2a1-7ccd07cdf4c2/server/0.log" Sep 07 04:18:25.334790 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:25.334757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-qvr6m_de09b934-9bd6-418d-ab34-0927ab4c2f56/manager/0.log" Sep 07 04:18:25.675075 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:25.674995 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-89nlk_e9d155d5-6413-46c2-af6b-967f117e5199/postgres/0.log" Sep 07 04:18:26.597765 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:26.597736 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-d84qb_4f851eb7-49a1-4d00-8972-4b32b0d2390c/manager/0.log" Sep 07 04:18:26.959455 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:26.959430 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-5hgzt_3586f194-5c46-4385-8783-f2c3573cdb4a/manager/0.log" Sep 07 04:18:27.192554 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:27.192526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-xfr2r_f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a/manager/0.log" Sep 07 04:18:27.550452 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:27.550423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr_ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed/istio-proxy/0.log" Sep 07 04:18:27.677221 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:27.677188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sd7wm_1fb903e9-001f-4625-b068-a1b89e9bf916/discovery/0.log" Sep 07 04:18:28.023373 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:28.023341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26_ed801bd4-de89-47d5-9bfe-a4c450d5bc07/istio-proxy/0.log" Sep 07 04:18:36.846221 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:36.846188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q7bxz_87010d61-5656-4487-ab32-47577943ddf5/global-pull-secret-syncer/0.log" Sep 07 04:18:36.952137 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:36.952102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xmhtt_69a199ad-8452-4357-9503-6a6c916f32f3/konnectivity-agent/0.log" Sep 07 04:18:37.040309 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:37.040281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-54.ec2.internal_c8abc5811eae218b508d7d4b044d4dc6/haproxy/0.log" Sep 07 04:18:41.741228 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:41.741199 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-d84qb_4f851eb7-49a1-4d00-8972-4b32b0d2390c/manager/0.log" Sep 07 04:18:41.839828 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:41.839793 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-5hgzt_3586f194-5c46-4385-8783-f2c3573cdb4a/manager/0.log" Sep 07 04:18:41.912635 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:41.912602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-xfr2r_f4cfdcb7-d926-4e03-95cb-9d4340d4ad8a/manager/0.log" Sep 07 04:18:43.705354 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:43.705327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwmwg_ab15b173-5aee-4919-92aa-dfa26a53e5e3/node-exporter/0.log" Sep 07 04:18:43.726950 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:43.726926 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwmwg_ab15b173-5aee-4919-92aa-dfa26a53e5e3/kube-rbac-proxy/0.log" Sep 07 04:18:43.748856 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:43.748830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwmwg_ab15b173-5aee-4919-92aa-dfa26a53e5e3/init-textfile/0.log" Sep 07 04:18:45.740654 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:45.740621 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-z6qqf_fc96d260-d2e1-4c75-a6c5-0d0e7d0422c7/networking-console-plugin/0.log" Sep 07 04:18:46.495449 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.495412 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz"] Sep 07 04:18:46.498564 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.498548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.500917 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.500874 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzmqv\"/\"default-dockercfg-b8znq\"" Sep 07 04:18:46.501920 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.501899 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzmqv\"/\"kube-root-ca.crt\"" Sep 07 04:18:46.501920 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.501915 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzmqv\"/\"openshift-service-ca.crt\"" Sep 07 04:18:46.505888 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.505858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz"] Sep 07 04:18:46.523170 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.523148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-podres\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.523297 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.523188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-lib-modules\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.523297 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.523272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48mpg\" (UniqueName: \"kubernetes.io/projected/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-kube-api-access-48mpg\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.523374 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.523303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-proc\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.523374 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.523320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-sys\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624753 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-lib-modules\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48mpg\" (UniqueName: \"kubernetes.io/projected/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-kube-api-access-48mpg\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-proc\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-sys\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-podres\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-lib-modules\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-sys\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-proc\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.624941 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.624944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-podres\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.632395 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.632367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48mpg\" (UniqueName: \"kubernetes.io/projected/97fd40d0-0c1b-4295-9a22-d2fa5bae132e-kube-api-access-48mpg\") pod \"perf-node-gather-daemonset-c42dz\" (UID: \"97fd40d0-0c1b-4295-9a22-d2fa5bae132e\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:46.810020 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:46.809915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:47.082348 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:47.082319 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz"] Sep 07 04:18:47.084423 ip-10-0-143-54 kubenswrapper[2579]: W0907 04:18:47.084392 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97fd40d0_0c1b_4295_9a22_d2fa5bae132e.slice/crio-7344ccc8426c7446bd59fedb6d79121bcf8c34455fa491580d687e9d6356f98e WatchSource:0}: Error finding container 7344ccc8426c7446bd59fedb6d79121bcf8c34455fa491580d687e9d6356f98e: Status 404 returned error can't find the container with id 7344ccc8426c7446bd59fedb6d79121bcf8c34455fa491580d687e9d6356f98e Sep 07 04:18:47.517456 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:47.517407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" event={"ID":"97fd40d0-0c1b-4295-9a22-d2fa5bae132e","Type":"ContainerStarted","Data":"82e7be10a6d6af62e966a2061ded7d9c95e28e8d34778ef06224eb25d33643ed"} Sep 07 04:18:47.517650 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:47.517510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" event={"ID":"97fd40d0-0c1b-4295-9a22-d2fa5bae132e","Type":"ContainerStarted","Data":"7344ccc8426c7446bd59fedb6d79121bcf8c34455fa491580d687e9d6356f98e"} Sep 07 04:18:47.518614 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:47.518590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:47.535852 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:47.535805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" podStartSLOduration=1.535789603 podStartE2EDuration="1.535789603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 04:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:18:47.534284272 +0000 UTC m=+1275.189852816" watchObservedRunningTime="2026-09-07 04:18:47.535789603 +0000 UTC m=+1275.191358146" Sep 07 04:18:48.514152 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:48.514120 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzjl7_aff9fd53-4913-4dc1-946d-bbc356ade55e/dns/0.log" Sep 07 04:18:48.533846 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:48.533817 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzjl7_aff9fd53-4913-4dc1-946d-bbc356ade55e/kube-rbac-proxy/0.log" Sep 07 04:18:48.599166 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:48.599133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5rz6f_6ebfbf69-5462-4af2-aedf-01685306f527/dns-node-resolver/0.log" Sep 07 04:18:49.218976 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:49.218943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dfz9w_0ad8ec9f-35dd-4028-b350-43bfb07a7a88/node-ca/0.log" Sep 07 04:18:50.122382 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:50.122335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr_ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed/istio-proxy/0.log" Sep 07 04:18:50.153456 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:50.153426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sd7wm_1fb903e9-001f-4625-b068-a1b89e9bf916/discovery/0.log" Sep 07 04:18:50.219376 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:50.219344 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26_ed801bd4-de89-47d5-9bfe-a4c450d5bc07/istio-proxy/0.log" Sep 07 04:18:50.814257 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:50.814231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mt8sr_31370701-a241-4364-84cd-0551358f7870/serve-healthcheck-canary/0.log" Sep 07 04:18:51.442204 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:51.442170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql7wd_d7f72c41-a768-491d-9fe1-8593e1e77c58/kube-rbac-proxy/0.log" Sep 07 04:18:51.461073 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:51.461048 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql7wd_d7f72c41-a768-491d-9fe1-8593e1e77c58/exporter/0.log" Sep 07 04:18:51.480523 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:51.480495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql7wd_d7f72c41-a768-491d-9fe1-8593e1e77c58/extractor/0.log" Sep 07 04:18:53.512324 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:53.512297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-74f7b546fd-2jszj_f074f6cf-2ea7-45ff-8cca-26a637c39c74/manager/0.log" Sep 07 04:18:53.534080 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:53.534053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-74f7b546fd-2jszj_f074f6cf-2ea7-45ff-8cca-26a637c39c74/copy-manifests/0.log" Sep 07 04:18:54.536510 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:54.536482 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-c42dz" Sep 07 04:18:54.708857 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:54.708828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-kgstk_74821336-d4ad-4a40-9889-5ac066020961/jobset-operator/0.log" Sep 07 04:18:55.277876 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.277844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-m7nwn_f4c0e73b-7271-457d-9eb6-62d2aeafe521/manager/0.log" Sep 07 04:18:55.338923 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.338891 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b6fdbb89f-s9bzb_9c43c3bf-0b50-4fc6-803c-4effe57405c4/manager/0.log" Sep 07 04:18:55.359447 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.359422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-2qvxg_d2c427ff-be39-4026-b2a1-7ccd07cdf4c2/server/0.log" Sep 07 04:18:55.363807 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.363782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr_ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed/istio-proxy/0.log" Sep 07 04:18:55.387414 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.387384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-qvr6m_de09b934-9bd6-418d-ab34-0927ab4c2f56/manager/0.log" Sep 07 04:18:55.389765 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.389744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sd7wm_1fb903e9-001f-4625-b068-a1b89e9bf916/discovery/0.log" Sep 07 04:18:55.433458 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:55.433428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26_ed801bd4-de89-47d5-9bfe-a4c450d5bc07/istio-proxy/0.log" Sep 07 04:18:56.537008 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:56.536974 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-sj8wr_ccfa7c88-fcd4-4a0e-84b4-51e236ab00ed/istio-proxy/0.log" Sep 07 04:18:56.563363 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:56.563332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sd7wm_1fb903e9-001f-4625-b068-a1b89e9bf916/discovery/0.log" Sep 07 04:18:56.614771 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:18:56.614735 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-hsh26_ed801bd4-de89-47d5-9bfe-a4c450d5bc07/istio-proxy/0.log" Sep 07 04:19:01.995029 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:01.994999 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/kube-multus-additional-cni-plugins/0.log" Sep 07 04:19:02.015131 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.015099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/egress-router-binary-copy/0.log" Sep 07 04:19:02.126844 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.126817 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/cni-plugins/0.log" Sep 07 04:19:02.146276 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.146250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/bond-cni-plugin/0.log" Sep 07 04:19:02.166257 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.166233 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/routeoverride-cni/0.log" Sep 07 04:19:02.187101 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.187069 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/whereabouts-cni-bincopy/0.log" Sep 07 04:19:02.204940 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.204914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz99m_60125676-ef69-4ee5-8463-ff00c7735c9a/whereabouts-cni/0.log" Sep 07 04:19:02.234366 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.234337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ccfcr_7bc9200f-e8a9-41ff-9d6a-8dbc98719864/kube-multus/0.log" Sep 07 04:19:02.251983 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.251914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6hr6m_58775b98-3ad6-4949-8eea-804ce2783a3f/network-metrics-daemon/0.log" Sep 07 04:19:02.269264 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:02.269237 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6hr6m_58775b98-3ad6-4949-8eea-804ce2783a3f/kube-rbac-proxy/0.log" Sep 07 04:19:03.313179 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.313152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/ovn-controller/0.log" Sep 07 04:19:03.330873 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.330850 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/ovn-acl-logging/0.log" Sep 07 04:19:03.354875 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.354845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/kube-rbac-proxy-node/0.log" Sep 07 04:19:03.375453 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.375423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 04:19:03.393531 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.393501 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/northd/0.log" Sep 07 04:19:03.414776 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.414753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/nbdb/0.log" Sep 07 04:19:03.435237 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.435206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/sbdb/0.log" Sep 07 04:19:03.473618 ip-10-0-143-54 kubenswrapper[2579]: I0907 04:19:03.473586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gq5p9_6e6f28ae-470c-4e2b-aefc-3ee361ed3581/ovnkube-controller/0.log"