Sep 11 01:59:55.460398 ip-10-0-135-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 11 01:59:55.460408 ip-10-0-135-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 11 01:59:55.460415 ip-10-0-135-234 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 11 01:59:55.460563 ip-10-0-135-234 systemd[1]: Failed to start Kubernetes Kubelet. Sep 11 02:00:06.716452 ip-10-0-135-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 11 02:00:06.716470 ip-10-0-135-234 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 494a6a1f2998447fb5c0b558bd8a482f -- Sep 11 02:02:00.601280 ip-10-0-135-234 systemd[1]: Starting Kubernetes Kubelet... Sep 11 02:02:01.029101 ip-10-0-135-234 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:02:01.029101 ip-10-0-135-234 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 02:02:01.029101 ip-10-0-135-234 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:02:01.029101 ip-10-0-135-234 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 02:02:01.029101 ip-10-0-135-234 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:02:01.031143 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.031037 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 02:02:01.035771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035753 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.035771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035770 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035774 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035778 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035781 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035784 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035788 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035791 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035795 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035799 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035803 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035806 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035809 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035818 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035822 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035825 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035828 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035831 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035834 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035836 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.035837 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035839 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035841 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035845 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035848 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035851 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035854 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035856 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035859 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035861 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035864 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035867 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035869 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035872 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035874 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035877 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035879 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035883 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035885 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035888 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.036313 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035891 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035893 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035896 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035898 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035901 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035903 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035906 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035908 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035910 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035913 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035915 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035918 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035920 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035923 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035925 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035929 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035932 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035934 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035938 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035941 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.036782 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035943 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035946 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035949 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035952 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035954 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035957 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035959 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035962 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035964 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035967 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035969 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035972 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035977 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035979 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035981 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.035998 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036000 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036003 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036006 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036008 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.037322 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036013 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036016 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036019 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036022 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036025 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036028 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036030 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036034 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036037 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036040 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036043 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036046 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036049 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036052 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036054 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036057 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036059 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036062 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036064 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036067 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036822 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.037816 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036829 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036833 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036836 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036841 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036846 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036849 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036852 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036855 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036858 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036861 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036864 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036867 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036870 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036872 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036875 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036877 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036880 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036883 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036886 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.038356 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036889 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036891 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036894 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036897 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036899 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036902 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036904 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036907 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036909 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036912 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036914 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036917 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036919 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036922 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036924 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036927 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036930 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036932 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036935 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036938 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.038833 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036941 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036943 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036946 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036948 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036952 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036955 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036957 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036960 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036962 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036965 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036968 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036971 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036973 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036976 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036979 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036996 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.036999 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037001 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037004 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.039423 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037007 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037010 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037012 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037015 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037017 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037020 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037022 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037025 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037027 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037030 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037032 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037035 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037038 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037041 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037044 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037048 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037051 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037055 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037058 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037060 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.039918 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037063 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037066 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037068 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037072 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037075 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037078 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037080 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037083 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037085 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037088 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037090 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037093 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037095 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037100 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037103 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037106 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037108 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037111 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037114 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.040430 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037117 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037501 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037507 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037510 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037513 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037516 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037519 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037522 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037525 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037527 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037530 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037533 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037536 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037538 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037541 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037543 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037546 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037549 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037552 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037554 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.040908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037557 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037559 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037562 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037565 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037567 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037570 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037572 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037575 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037577 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037580 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037582 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037585 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037587 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037590 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037592 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037595 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037600 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037603 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037607 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037609 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.041420 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037612 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037615 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037618 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037620 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037623 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037626 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037629 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037631 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037634 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037638 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037641 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037644 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037646 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037649 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037652 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037654 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037657 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037659 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037662 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037664 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.041908 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037666 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037672 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037675 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037677 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037679 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037682 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037685 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037687 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037690 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037692 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037695 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037697 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037700 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037703 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037705 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037708 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037711 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037713 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037716 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.042452 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037723 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037727 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037730 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037734 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037736 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037739 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037741 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037744 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037746 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037749 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037751 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037753 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037756 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037758 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037761 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037763 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037766 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037768 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037771 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.042996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.037773 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037851 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037884 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037891 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037895 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037902 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037905 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037912 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037916 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037919 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037922 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037926 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037929 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037933 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037936 2581 flags.go:64] FLAG: --cgroup-root="" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037939 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037942 2581 flags.go:64] FLAG: --client-ca-file="" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037945 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037948 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037952 2581 flags.go:64] FLAG: --cluster-domain="" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037955 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037958 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037961 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037965 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 02:02:01.043474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037968 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037972 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037974 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037978 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037981 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.037997 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038000 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038003 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038006 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038010 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038013 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038016 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038019 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038022 2581 flags.go:64] FLAG: --enable-server="true" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038028 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038034 2581 flags.go:64] FLAG: --event-burst="100" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038037 2581 flags.go:64] FLAG: --event-qps="50" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038039 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038042 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038045 2581 flags.go:64] FLAG: --eviction-hard="" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038049 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038052 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038055 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038059 2581 flags.go:64] FLAG: --eviction-soft="" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038061 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 02:02:01.044083 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038065 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038068 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038072 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038075 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038077 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038080 2581 flags.go:64] FLAG: --feature-gates="" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038085 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038088 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038091 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038094 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038097 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038100 2581 flags.go:64] FLAG: --help="false" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038104 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038107 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038109 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038112 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038116 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038119 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038122 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038125 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038127 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038130 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038135 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038139 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 02:02:01.044720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038142 2581 flags.go:64] FLAG: --kube-reserved="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038144 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038147 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038150 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038153 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038156 2581 flags.go:64] FLAG: --lock-file="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038159 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038162 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038165 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038171 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038174 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038176 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038179 2581 flags.go:64] FLAG: --logging-format="text" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038182 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038185 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038189 2581 flags.go:64] FLAG: --manifest-url="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038192 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038196 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038199 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038204 2581 flags.go:64] FLAG: --max-pods="110" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038207 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038210 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038213 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038216 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038218 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 02:02:01.045347 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038222 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038225 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038233 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038236 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038239 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038243 2581 flags.go:64] FLAG: --pod-cidr="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038247 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038252 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038255 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038259 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038262 2581 flags.go:64] FLAG: --port="10250" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038265 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038268 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-091690c33feb78a75" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038271 2581 flags.go:64] FLAG: --qos-reserved="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038274 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038277 2581 flags.go:64] FLAG: --register-node="true" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038279 2581 flags.go:64] FLAG: --register-with-taints="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038283 2581 flags.go:64] FLAG: --registry-burst="10" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038286 2581 flags.go:64] FLAG: --registry-qps="5" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038288 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038291 2581 flags.go:64] FLAG: --reserved-memory="" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038295 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038298 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038301 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038304 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 02:02:01.046217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038307 2581 flags.go:64] FLAG: --runonce="false" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038310 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038313 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038316 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038318 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038321 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038324 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038327 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038330 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038333 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038336 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038339 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038343 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038346 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038350 2581 flags.go:64] FLAG: --system-cgroups="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038353 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038358 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038361 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038364 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038370 2581 flags.go:64] FLAG: --tls-min-version="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038373 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038376 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038379 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038382 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038385 2581 flags.go:64] FLAG: --v="2" Sep 11 02:02:01.047214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038389 2581 flags.go:64] FLAG: --version="false" Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038393 2581 flags.go:64] FLAG: --vmodule="" Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038397 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.038400 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038537 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038541 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038545 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038548 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038551 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038554 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038556 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038560 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038564 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038567 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038570 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038572 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038575 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038578 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038582 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.047853 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038587 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038590 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038594 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038597 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038600 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038602 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038605 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038609 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038612 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038615 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038617 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038620 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038623 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038626 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038628 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038632 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038636 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038640 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038646 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038650 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.048527 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038653 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038656 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038658 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038661 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038663 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038666 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038669 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038671 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038674 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038676 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038679 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038682 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038686 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038689 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038691 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038694 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038697 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038700 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038702 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038707 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.049270 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038710 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038712 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038715 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038717 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038720 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038723 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038725 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038728 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038731 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038733 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038736 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038738 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038741 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038744 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038746 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038749 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038752 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038754 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038757 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038759 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038762 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.049771 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038764 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038767 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038769 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038773 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038776 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038778 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038781 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038783 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038786 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038788 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038793 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038795 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038798 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038801 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038804 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038806 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038809 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038811 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038814 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038817 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.050362 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038819 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038822 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.038825 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.039739 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047022 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047159 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047177 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047184 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047243 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047248 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047252 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047255 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047258 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047261 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.050860 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047264 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047267 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047270 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047273 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047276 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047278 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047281 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047284 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047286 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047290 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047292 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047295 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047298 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047301 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047304 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047306 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047309 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047312 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047314 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047317 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.051293 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047320 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047322 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047325 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047329 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047332 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047335 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047337 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047340 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047343 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047346 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047348 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047351 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047353 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047357 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047359 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047361 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047364 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047366 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047369 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.051935 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047371 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047374 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047377 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047379 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047382 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047385 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047387 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047390 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047392 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047395 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047397 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047400 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047402 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047405 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047408 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047410 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047413 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047416 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047419 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047421 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.052661 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047424 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047427 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047429 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047432 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047434 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047438 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047441 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047444 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047447 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047450 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047453 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047455 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047458 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047461 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047464 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047466 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047469 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047475 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.053523 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047477 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047480 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047482 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047485 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047488 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047490 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047493 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047496 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047498 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047501 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047504 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047508 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047512 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047516 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047520 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.054082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047526 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047652 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047658 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047661 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047664 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047667 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047670 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047673 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047676 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047679 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047682 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047685 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047688 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047691 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047694 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047696 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047699 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047701 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047704 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047706 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:02:01.054610 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047709 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047712 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047716 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047719 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047722 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047725 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047728 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047730 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047733 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047737 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047740 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047744 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047746 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047749 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047752 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047755 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047757 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047760 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047762 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:02:01.055130 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047765 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047768 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047770 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047773 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047776 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047778 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047781 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047783 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047786 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047788 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047791 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047793 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047796 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047798 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047801 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047804 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047806 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047809 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047811 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:02:01.055672 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047814 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047817 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047819 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047822 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047825 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047827 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047830 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047832 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047835 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047837 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047840 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047843 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047845 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047848 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047850 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047853 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047856 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047861 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047864 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:02:01.056337 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047866 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047869 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047872 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047874 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047877 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047879 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047882 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047885 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047887 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047890 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047892 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047895 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047901 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047904 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047907 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047909 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047912 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047915 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047917 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047920 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:02:01.056827 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047923 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:01.047927 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.047932 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.051518 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.054196 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.055318 2581 server.go:1019] "Starting client certificate rotation" Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.055432 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:02:01.057400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.055470 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:02:01.058091 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.058072 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:02:01.059353 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.059331 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:02:01.067044 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.067026 2581 log.go:25] "Validated CRI v1 runtime API" Sep 11 02:02:01.070808 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.070778 2581 log.go:25] "Validated CRI v1 image API" Sep 11 02:02:01.071886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.071869 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 02:02:01.075307 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.075285 2581 fs.go:135] Filesystem UUIDs: map[478b1396-dcb8-4739-94a5-edce43708421:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c7daa968-8264-45d7-9cab-3899e336fdf2:/dev/nvme0n1p4] Sep 11 02:02:01.075359 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.075309 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 02:02:01.082873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.082726 2581 manager.go:216] Machine: {Timestamp:2026-09-11 02:02:01.081115598 +0000 UTC m=+0.357406202 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100189 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200bc480b401be639661c097f6ced8 SystemUUID:ec200bc4-80b4-01be-6396-61c097f6ced8 BootID:494a6a1f-2998-447f-b5c0-b558bd8a482f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:cb:85:1f:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:cb:85:1f:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:a3:a4:69:3d:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 02:02:01.082873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.082864 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 02:02:01.083052 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.083037 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 02:02:01.083476 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.083460 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:02:01.085435 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.085410 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 02:02:01.085583 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.085440 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 02:02:01.087050 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.087039 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 02:02:01.087084 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.087054 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 02:02:01.087084 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.087062 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:02:01.087634 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.087613 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:02:01.088425 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.088415 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 02:02:01.092379 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092367 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:02:01.092512 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092503 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 02:02:01.092553 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092534 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 11 02:02:01.092553 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092544 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 02:02:01.092628 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092555 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 02:02:01.092628 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092566 2581 kubelet.go:398] "Adding apiserver pod source" Sep 11 02:02:01.092628 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.092576 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 02:02:01.093131 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.093108 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:02:01.093224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.093148 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:02:01.097320 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.097297 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 02:02:01.099450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.099435 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 02:02:01.099531 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.099465 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 02:02:01.100899 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100887 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100904 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100911 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100918 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100927 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100933 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100946 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100951 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100959 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100968 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.100980 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 02:02:01.101020 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.101016 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 02:02:01.101471 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.101341 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 02:02:01.101471 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.101380 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 02:02:01.101960 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.101947 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 02:02:01.102007 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.101961 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 02:02:01.102327 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.102307 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pxtrz" Sep 11 02:02:01.103839 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.103822 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 02:02:01.105959 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.105946 2581 server.go:1268] "Started kubelet" Sep 11 02:02:01.106070 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.106046 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 02:02:01.106225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.106176 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 02:02:01.106268 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.106247 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 02:02:01.107108 ip-10-0-135-234 systemd[1]: Started Kubernetes Kubelet. Sep 11 02:02:01.108487 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.108474 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 11 02:02:01.109918 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.109899 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pxtrz" Sep 11 02:02:01.110373 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.110335 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 02:02:01.110631 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.110618 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 02:02:01.116439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.116420 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 02:02:01.116439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.116433 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 02:02:01.116588 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.116541 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.117032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.117015 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 02:02:01.117032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.117019 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 02:02:01.117175 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.117040 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 02:02:01.117175 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.117152 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 11 02:02:01.117175 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.117161 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 11 02:02:01.119343 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119324 2581 factory.go:55] Registering systemd factory Sep 11 02:02:01.119408 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119346 2581 factory.go:223] Registration of the systemd container factory successfully Sep 11 02:02:01.119578 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119565 2581 factory.go:153] Registering CRI-O factory Sep 11 02:02:01.119640 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119580 2581 factory.go:223] Registration of the crio container factory successfully Sep 11 02:02:01.119684 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119675 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 02:02:01.119715 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119697 2581 factory.go:103] Registering Raw factory Sep 11 02:02:01.119715 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.119709 2581 manager.go:1196] Started watching for new ooms in manager Sep 11 02:02:01.120127 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.120113 2581 manager.go:349] Starting recovery of all containers Sep 11 02:02:01.120232 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.120162 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:01.123832 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.123810 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-234.ec2.internal\" not found" node="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.131090 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.131070 2581 manager.go:354] Recovery completed Sep 11 02:02:01.133895 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.133870 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 11 02:02:01.137128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.137111 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.138871 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.138855 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.138952 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.138884 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.138952 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.138895 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.139519 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.139504 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 02:02:01.139599 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.139518 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.139599 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.139519 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 02:02:01.139599 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.139591 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:02:01.140268 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.140244 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.140361 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.140276 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.140361 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.140290 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.141818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.141799 2581 policy_none.go:49] "None policy: Start" Sep 11 02:02:01.141818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.141818 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 02:02:01.141893 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.141828 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 02:02:01.143767 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.143755 2581 policy_none.go:47] "Start" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.190720 2581 manager.go:337] "Starting Device Plugin manager" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.190762 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.190775 2581 server.go:87] "Starting device plugin registration server" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.191125 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.191141 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.191229 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.191347 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.191356 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.191848 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 02:02:01.194911 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.191893 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.211508 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.211481 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 02:02:01.212766 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.212742 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 02:02:01.212868 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.212793 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 02:02:01.212868 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.212833 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 02:02:01.212955 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.212881 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 02:02:01.214855 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.214837 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:01.291860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.291738 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.292724 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.292705 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.292832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.292744 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.292832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.292758 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.292832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.292787 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.299333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.299315 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.299427 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.299338 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-234.ec2.internal\": node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.313207 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.313178 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal"] Sep 11 02:02:01.313330 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.313270 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.314134 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.314115 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.314231 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.314142 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.314231 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.314152 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.314542 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.314527 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.316484 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.316471 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.316592 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.316580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.316637 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.316604 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.317204 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317188 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.317283 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317212 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.317283 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317221 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.317283 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317193 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.317380 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317287 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.317380 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.317298 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.318059 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.318044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aad02c598c34e433b851df1c8655299-config\") pod \"kube-apiserver-proxy-ip-10-0-135-234.ec2.internal\" (UID: \"8aad02c598c34e433b851df1c8655299\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.318141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.318066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.318141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.318085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.319411 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.319397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.319477 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.319420 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:02:01.320088 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.320072 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:02:01.320179 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.320099 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:02:01.320179 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.320110 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:02:01.346683 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.346658 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-234.ec2.internal\" not found" node="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.350979 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.350961 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-234.ec2.internal\" not found" node="ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.414662 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.414628 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.418923 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.418903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aad02c598c34e433b851df1c8655299-config\") pod \"kube-apiserver-proxy-ip-10-0-135-234.ec2.internal\" (UID: \"8aad02c598c34e433b851df1c8655299\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.419023 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.418935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.419023 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.418957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.419023 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.419013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.419127 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.419025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4906ce7cee97908c4a87e7928af19d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal\" (UID: \"4906ce7cee97908c4a87e7928af19d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.419127 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.419038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aad02c598c34e433b851df1c8655299-config\") pod \"kube-apiserver-proxy-ip-10-0-135-234.ec2.internal\" (UID: \"8aad02c598c34e433b851df1c8655299\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.514973 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.514937 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.615487 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.615407 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.649884 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.649859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.653459 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:01.653431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:01.716148 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.716118 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.816595 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.816562 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:01.917080 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:01.917013 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:02.017448 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:02.017410 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:02.050505 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.050479 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:02.055206 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.055188 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 02:02:02.055362 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.055340 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:02:02.055415 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.055340 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:02:02.055415 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.055342 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:02:02.116771 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.116726 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 01:57:01 +0000 UTC" deadline="2028-05-25 02:53:40.434754758 +0000 UTC" Sep 11 02:02:02.116900 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.116778 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14928h51m38.317992906s" Sep 11 02:02:02.117897 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:02.117885 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-234.ec2.internal\" not found" Sep 11 02:02:02.217454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.217376 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:02.317130 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.316937 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" Sep 11 02:02:02.326724 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.326701 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:02:02.327666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.327651 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" Sep 11 02:02:02.335655 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.335639 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:02:02.402347 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:02.402317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aad02c598c34e433b851df1c8655299.slice/crio-4eea2691375cb699d147f089e73f40b75134bab233d781e520ca79d710c55ac3 WatchSource:0}: Error finding container 4eea2691375cb699d147f089e73f40b75134bab233d781e520ca79d710c55ac3: Status 404 returned error can't find the container with id 4eea2691375cb699d147f089e73f40b75134bab233d781e520ca79d710c55ac3 Sep 11 02:02:02.402593 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:02.402568 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4906ce7cee97908c4a87e7928af19d55.slice/crio-da6ebe8ac1417e51636ae5a6e3a1ebf057b9da13dcbc161fc5e79516018a83e4 WatchSource:0}: Error finding container da6ebe8ac1417e51636ae5a6e3a1ebf057b9da13dcbc161fc5e79516018a83e4: Status 404 returned error can't find the container with id da6ebe8ac1417e51636ae5a6e3a1ebf057b9da13dcbc161fc5e79516018a83e4 Sep 11 02:02:02.406881 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:02.406860 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:02:03.093718 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.093683 2581 apiserver.go:52] "Watching apiserver" Sep 11 02:02:03.105545 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.105316 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 02:02:03.106363 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.106337 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-mtjkg","openshift-network-diagnostics/network-check-target-g2nb5","kube-system/konnectivity-agent-m8dz7","openshift-cluster-node-tuning-operator/tuned-vct4t","openshift-dns/node-resolver-28wk7","openshift-image-registry/node-ca-fhs86","openshift-network-operator/iptables-alerter-wjb6d","openshift-ovn-kubernetes/ovnkube-node-xgbmv","kube-system/global-pull-secret-syncer-8vrxg","kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal","openshift-multus/multus-9t7hm","openshift-multus/multus-additional-cni-plugins-n9r9k"] Sep 11 02:02:03.109146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.109118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.111146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.111123 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 02:02:03.111864 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.111351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:03.111864 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.111430 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:03.111864 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.111521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.111864 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.111706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.111864 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.111730 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hsjxg\"" Sep 11 02:02:03.113430 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.113409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.115429 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.115406 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.115524 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.115483 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 02:02:03.115682 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.115596 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.115968 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.115790 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6gz6x\"" Sep 11 02:02:03.116525 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.116177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.117652 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.116999 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 02:02:03.118514 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.118142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.118514 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.118263 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.118514 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.118459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.118687 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.118526 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 02:02:03.118941 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.118890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-phkcc\"" Sep 11 02:02:03.120145 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.120126 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.120377 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.120355 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.120681 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.120658 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76hzp\"" Sep 11 02:02:03.121021 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.121003 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.123179 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.123160 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.123421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.123404 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.123496 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.123451 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qnxnl\"" Sep 11 02:02:03.123855 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.123799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.123919 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.123900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:03.127206 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.126594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.127456 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.127434 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:02:03.128476 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.128476 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-iptables-alerter-script\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-hosts-file\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-host\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qp9j\" (UniqueName: \"kubernetes.io/projected/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-kube-api-access-5qp9j\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-tmp-dir\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.128666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cth6n\" (UniqueName: \"kubernetes.io/projected/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-kube-api-access-cth6n\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-serviceca\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trz9q\" (UniqueName: \"kubernetes.io/projected/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-kube-api-access-trz9q\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-socket-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128745 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-registration-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-sys-fs\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvnnb\" (UniqueName: \"kubernetes.io/projected/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kube-api-access-fvnnb\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-host-slash\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-device-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.129082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.128913 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.129613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129094 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 02:02:03.129613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.129613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 02:02:03.129613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129472 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 02:02:03.129802 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvqh6\"" Sep 11 02:02:03.129802 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.129739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.129924 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.129795 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:03.132681 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.132610 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.135218 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.134747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 02:02:03.135218 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.134864 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 02:02:03.135218 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.134999 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x7ht2\"" Sep 11 02:02:03.135379 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.135291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.137141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 02:02:03.137259 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.137738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fz2vf\"" Sep 11 02:02:03.137738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137499 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 02:02:03.137738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137567 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 02:02:03.137738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.137585 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 02:02:03.138997 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.138967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 02:02:03.140047 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.140032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qbgnn\"" Sep 11 02:02:03.140224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.140203 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 02:02:03.145735 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.145713 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtxhn" Sep 11 02:02:03.151848 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.151817 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtxhn" Sep 11 02:02:03.218023 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.217997 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 02:02:03.220545 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.220486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" event={"ID":"4906ce7cee97908c4a87e7928af19d55","Type":"ContainerStarted","Data":"da6ebe8ac1417e51636ae5a6e3a1ebf057b9da13dcbc161fc5e79516018a83e4"} Sep 11 02:02:03.221711 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.221680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" event={"ID":"8aad02c598c34e433b851df1c8655299","Type":"ContainerStarted","Data":"4eea2691375cb699d147f089e73f40b75134bab233d781e520ca79d710c55ac3"} Sep 11 02:02:03.229279 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-dbus\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.229406 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.229406 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-netd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.229406 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520b9582-76ab-4ffe-9a50-508d573b7307-konnectivity-ca\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-kubelet\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cth6n\" (UniqueName: \"kubernetes.io/projected/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-kube-api-access-cth6n\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-serviceca\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysconfig\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-cnibin\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.229617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-node-log\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-system-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-k8s-cni-cncf-io\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-run\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-kubelet-config\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-ovn\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-config\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-etc-kubernetes\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.229902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-etc-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-multus-certs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.229963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-serviceca\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-bin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvnnb\" (UniqueName: \"kubernetes.io/projected/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kube-api-access-fvnnb\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520b9582-76ab-4ffe-9a50-508d573b7307-agent-certs\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-multus\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:03.230302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-kubelet\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-var-lib-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-script-lib\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq9gj\" (UniqueName: \"kubernetes.io/projected/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-kube-api-access-zq9gj\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-systemd-units\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-conf-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-daemon-config\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2eb436f4-fe67-4f6e-a922-5249b835f447-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-hostroot\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-socket-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-registration-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.230827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-host-slash\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-socket-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-modprobe-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-registration-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-var-lib-kubelet\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-host-slash\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2k44\" (UniqueName: \"kubernetes.io/projected/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-kube-api-access-f2k44\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-log-socket\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.230977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-device-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-tmp\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-device-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-system-cni-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-systemd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.231437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-bin\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231162 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-host\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-sys\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-host\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-host\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-env-overrides\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44nsf\" (UniqueName: \"kubernetes.io/projected/2eb436f4-fe67-4f6e-a922-5249b835f447-kube-api-access-44nsf\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-cnibin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-cni-binary-copy\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkhrs\" (UniqueName: \"kubernetes.io/projected/6df07efe-e751-402d-b58f-4cb3e546de3c-kube-api-access-rkhrs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmzk\" (UniqueName: \"kubernetes.io/projected/ef36f517-4baf-4369-bb25-1c7cd86cf177-kube-api-access-fjmzk\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-slash\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qp9j\" (UniqueName: \"kubernetes.io/projected/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-kube-api-access-5qp9j\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.232297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-tmp-dir\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trz9q\" (UniqueName: \"kubernetes.io/projected/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-kube-api-access-trz9q\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-systemd\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-sys-fs\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-tuned\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-netns\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-lib-modules\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-iptables-alerter-script\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-hosts-file\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-socket-dir-parent\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-netns\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.231964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-kubernetes\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-sys-fs\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-hosts-file\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-conf\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.233114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-tmp-dir\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.233895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.232170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.233895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.233264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-iptables-alerter-script\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.234945 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.234922 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:03.235075 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.234951 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:03.235075 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.234964 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:03.235075 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.235064 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:03.735028462 +0000 UTC m=+3.011319053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:03.235245 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.235139 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 02:02:03.239921 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.239895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qp9j\" (UniqueName: \"kubernetes.io/projected/9c477cfd-d3ea-479c-a95c-a6f8ab23bc53-kube-api-access-5qp9j\") pod \"iptables-alerter-wjb6d\" (UID: \"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53\") " pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.240064 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.239895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvnnb\" (UniqueName: \"kubernetes.io/projected/f7657b76-defd-4c3c-9162-fa0f8a7584cd-kube-api-access-fvnnb\") pod \"aws-ebs-csi-driver-node-j5ktl\" (UID: \"f7657b76-defd-4c3c-9162-fa0f8a7584cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.240128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.240100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cth6n\" (UniqueName: \"kubernetes.io/projected/c28c23d5-02c5-4df0-8fcc-765bfcbe1f17-kube-api-access-cth6n\") pod \"node-resolver-28wk7\" (UID: \"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17\") " pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.240908 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.240879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trz9q\" (UniqueName: \"kubernetes.io/projected/10034a0c-3f07-4f9f-8693-5cde30aa7ba6-kube-api-access-trz9q\") pod \"node-ca-fhs86\" (UID: \"10034a0c-3f07-4f9f-8693-5cde30aa7ba6\") " pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.332908 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.332870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-etc-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.332908 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.332907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-multus-certs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.332926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.332941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-etc-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-bin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520b9582-76ab-4ffe-9a50-508d573b7307-agent-certs\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-bin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-multus\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-multus-certs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.333157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-kubelet\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-var-lib-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-cni-multus\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-script-lib\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-kubelet\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9gj\" (UniqueName: \"kubernetes.io/projected/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-kube-api-access-zq9gj\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-var-lib-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-systemd-units\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-conf-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-systemd-units\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-conf-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-daemon-config\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2eb436f4-fe67-4f6e-a922-5249b835f447-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-hostroot\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-modprobe-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-var-lib-kubelet\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.333645 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-hostroot\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2k44\" (UniqueName: \"kubernetes.io/projected/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-kube-api-access-f2k44\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-log-socket\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-tmp\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-system-cni-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-modprobe-d\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-log-socket\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-system-cni-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-systemd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-bin\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-var-lib-kubelet\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-sys\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.334452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333836 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-systemd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-host\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-env-overrides\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-sys\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44nsf\" (UniqueName: \"kubernetes.io/projected/2eb436f4-fe67-4f6e-a922-5249b835f447-kube-api-access-44nsf\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-cnibin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-bin\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-script-lib\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-cni-binary-copy\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.333838 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.333968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkhrs\" (UniqueName: \"kubernetes.io/projected/6df07efe-e751-402d-b58f-4cb3e546de3c-kube-api-access-rkhrs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmzk\" (UniqueName: \"kubernetes.io/projected/ef36f517-4baf-4369-bb25-1c7cd86cf177-kube-api-access-fjmzk\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.334045 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:03.834026405 +0000 UTC m=+3.110317003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-daemon-config\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-slash\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.334149 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:03.335269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-systemd\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.334206 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:03.834190218 +0000 UTC m=+3.110480797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-slash\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334248 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-tuned\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-openvswitch\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-netns\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-lib-modules\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-run-netns\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-socket-dir-parent\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-cnibin\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-netns\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-kubernetes\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-env-overrides\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-systemd\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-conf\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-dbus\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-netns\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-multus-socket-dir-parent\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-netd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520b9582-76ab-4ffe-9a50-508d573b7307-konnectivity-ca\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-kubelet\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-lib-modules\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysconfig\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-cnibin\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-node-log\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-system-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df07efe-e751-402d-b58f-4cb3e546de3c-cni-binary-copy\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysconfig\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334750 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-k8s-cni-cncf-io\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334587 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-kubernetes\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334788 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-host-cni-netd\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.336917 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-host\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-run-k8s-cni-cncf-io\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef36f517-4baf-4369-bb25-1c7cd86cf177-cnibin\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-run\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-kubelet-config\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-ovn\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-config\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.334925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-etc-kubernetes\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-etc-kubernetes\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-system-cni-dir\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-kubelet-config\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-run-ovn\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520b9582-76ab-4ffe-9a50-508d573b7307-konnectivity-ca\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-run\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df07efe-e751-402d-b58f-4cb3e546de3c-host-var-lib-kubelet\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-sysctl-conf\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2eb436f4-fe67-4f6e-a922-5249b835f447-node-log\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2eb436f4-fe67-4f6e-a922-5249b835f447-ovnkube-config\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.337748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.335653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db0071c5-7ec4-407d-860c-2272d7a8e461-dbus\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.336312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.336415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.336619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef36f517-4baf-4369-bb25-1c7cd86cf177-cni-binary-copy\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.336901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2eb436f4-fe67-4f6e-a922-5249b835f447-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.337238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-tmp\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.337656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520b9582-76ab-4ffe-9a50-508d573b7307-agent-certs\") pod \"konnectivity-agent-m8dz7\" (UID: \"520b9582-76ab-4ffe-9a50-508d573b7307\") " pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.338532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.338442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-etc-tuned\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.342234 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.342206 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq9gj\" (UniqueName: \"kubernetes.io/projected/7619f76c-58dc-4b2a-a6e6-6af8fd03370a-kube-api-access-zq9gj\") pod \"tuned-vct4t\" (UID: \"7619f76c-58dc-4b2a-a6e6-6af8fd03370a\") " pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.342657 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.342637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmzk\" (UniqueName: \"kubernetes.io/projected/ef36f517-4baf-4369-bb25-1c7cd86cf177-kube-api-access-fjmzk\") pod \"multus-additional-cni-plugins-n9r9k\" (UID: \"ef36f517-4baf-4369-bb25-1c7cd86cf177\") " pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.342751 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.342678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkhrs\" (UniqueName: \"kubernetes.io/projected/6df07efe-e751-402d-b58f-4cb3e546de3c-kube-api-access-rkhrs\") pod \"multus-9t7hm\" (UID: \"6df07efe-e751-402d-b58f-4cb3e546de3c\") " pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.343672 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.343652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44nsf\" (UniqueName: \"kubernetes.io/projected/2eb436f4-fe67-4f6e-a922-5249b835f447-kube-api-access-44nsf\") pod \"ovnkube-node-xgbmv\" (UID: \"2eb436f4-fe67-4f6e-a922-5249b835f447\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.344264 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.344209 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2k44\" (UniqueName: \"kubernetes.io/projected/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-kube-api-access-f2k44\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.423126 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.423080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fhs86" Sep 11 02:02:03.431404 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.431379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" Sep 11 02:02:03.441213 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.441191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjb6d" Sep 11 02:02:03.446795 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.446772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28wk7" Sep 11 02:02:03.457388 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.457363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vct4t" Sep 11 02:02:03.465059 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.465038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:03.472769 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.472742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:03.480449 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.480427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9t7hm" Sep 11 02:02:03.492368 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.492342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" Sep 11 02:02:03.524918 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.524880 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:03.656429 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.656356 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:03.737864 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.737823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:03.738088 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.738038 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:03.738088 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.738063 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:03.738088 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.738074 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:03.738237 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.738139 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:04.738124218 +0000 UTC m=+4.014414790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:03.838312 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.838271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:03.838312 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:03.838317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:03.838543 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.838448 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:03.838543 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.838470 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:03.838543 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.838534 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:04.838519042 +0000 UTC m=+4.114809615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:03.838683 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:03.838548 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:04.838542036 +0000 UTC m=+4.114832608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:04.154720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.154625 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 01:57:03 +0000 UTC" deadline="2028-03-22 15:10:24.741044898 +0000 UTC" Sep 11 02:02:04.154720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.154666 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13405h8m20.586383491s" Sep 11 02:02:04.402329 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.402297 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7657b76_defd_4c3c_9162_fa0f8a7584cd.slice/crio-f08bca3489c498e78748065184377248b51c457de553edf164cbc471e1397535 WatchSource:0}: Error finding container f08bca3489c498e78748065184377248b51c457de553edf164cbc471e1397535: Status 404 returned error can't find the container with id f08bca3489c498e78748065184377248b51c457de553edf164cbc471e1397535 Sep 11 02:02:04.403458 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.403434 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7619f76c_58dc_4b2a_a6e6_6af8fd03370a.slice/crio-3c5635c43d7a86fc3bf41df92a465702ab21c956b7ebce3e3024961b3509e873 WatchSource:0}: Error finding container 3c5635c43d7a86fc3bf41df92a465702ab21c956b7ebce3e3024961b3509e873: Status 404 returned error can't find the container with id 3c5635c43d7a86fc3bf41df92a465702ab21c956b7ebce3e3024961b3509e873 Sep 11 02:02:04.406088 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.405853 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10034a0c_3f07_4f9f_8693_5cde30aa7ba6.slice/crio-55979c720a0cab52b4cfa2f17111c3947b1933429bf2b72c31dff428a6477a78 WatchSource:0}: Error finding container 55979c720a0cab52b4cfa2f17111c3947b1933429bf2b72c31dff428a6477a78: Status 404 returned error can't find the container with id 55979c720a0cab52b4cfa2f17111c3947b1933429bf2b72c31dff428a6477a78 Sep 11 02:02:04.410036 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.410010 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb436f4_fe67_4f6e_a922_5249b835f447.slice/crio-9946a4c87db7833c2945724365b67139db5fedd92751be16327ae920215d47f5 WatchSource:0}: Error finding container 9946a4c87db7833c2945724365b67139db5fedd92751be16327ae920215d47f5: Status 404 returned error can't find the container with id 9946a4c87db7833c2945724365b67139db5fedd92751be16327ae920215d47f5 Sep 11 02:02:04.412015 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.411996 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520b9582_76ab_4ffe_9a50_508d573b7307.slice/crio-a3a340ef3828aca04f33cbcfdb899dffcceb0fe31535a242a54e2629de167e8f WatchSource:0}: Error finding container a3a340ef3828aca04f33cbcfdb899dffcceb0fe31535a242a54e2629de167e8f: Status 404 returned error can't find the container with id a3a340ef3828aca04f33cbcfdb899dffcceb0fe31535a242a54e2629de167e8f Sep 11 02:02:04.412963 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.412936 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df07efe_e751_402d_b58f_4cb3e546de3c.slice/crio-d20ce68e348ac4a80d9344292de825ee5c0400db1eafcf4e23f2544222dc4734 WatchSource:0}: Error finding container d20ce68e348ac4a80d9344292de825ee5c0400db1eafcf4e23f2544222dc4734: Status 404 returned error can't find the container with id d20ce68e348ac4a80d9344292de825ee5c0400db1eafcf4e23f2544222dc4734 Sep 11 02:02:04.415397 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.415373 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c477cfd_d3ea_479c_a95c_a6f8ab23bc53.slice/crio-1ab6f54d2e7699da1fde2cce596b99ca6c4573241c127496ac5973e58b6f4a9e WatchSource:0}: Error finding container 1ab6f54d2e7699da1fde2cce596b99ca6c4573241c127496ac5973e58b6f4a9e: Status 404 returned error can't find the container with id 1ab6f54d2e7699da1fde2cce596b99ca6c4573241c127496ac5973e58b6f4a9e Sep 11 02:02:04.416460 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.416429 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28c23d5_02c5_4df0_8fcc_765bfcbe1f17.slice/crio-ecf54e353a0b9e924670194d8725d02f0dbf3bb66ac7cf97af70f12187ffc381 WatchSource:0}: Error finding container ecf54e353a0b9e924670194d8725d02f0dbf3bb66ac7cf97af70f12187ffc381: Status 404 returned error can't find the container with id ecf54e353a0b9e924670194d8725d02f0dbf3bb66ac7cf97af70f12187ffc381 Sep 11 02:02:04.417349 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:04.417326 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef36f517_4baf_4369_bb25_1c7cd86cf177.slice/crio-76fa40196fe6f5cf2bdae4b174ad81b3bc2f0e9c11ef8de7d89c01bd0682c46c WatchSource:0}: Error finding container 76fa40196fe6f5cf2bdae4b174ad81b3bc2f0e9c11ef8de7d89c01bd0682c46c: Status 404 returned error can't find the container with id 76fa40196fe6f5cf2bdae4b174ad81b3bc2f0e9c11ef8de7d89c01bd0682c46c Sep 11 02:02:04.746845 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.746811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:04.747011 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.746946 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:04.747011 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.746963 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:04.747011 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.746973 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:04.747155 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.747045 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:06.747014308 +0000 UTC m=+6.023304900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.847704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.847788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.847941 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.848008 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:06.847987775 +0000 UTC m=+6.124278362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.848446 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:04.848535 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:04.848509 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:06.84849202 +0000 UTC m=+6.124782598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:04.991146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:04.991045 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:02:05.155824 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.155766 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 01:57:03 +0000 UTC" deadline="2028-06-15 20:13:00.630286596 +0000 UTC" Sep 11 02:02:05.155824 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.155813 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15450h10m55.474478628s" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.216950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:05.217105 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.217523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:05.217623 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.217691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:05.217905 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:05.217776 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:05.233179 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.233065 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"9946a4c87db7833c2945724365b67139db5fedd92751be16327ae920215d47f5"} Sep 11 02:02:05.244490 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.244403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fhs86" event={"ID":"10034a0c-3f07-4f9f-8693-5cde30aa7ba6","Type":"ContainerStarted","Data":"55979c720a0cab52b4cfa2f17111c3947b1933429bf2b72c31dff428a6477a78"} Sep 11 02:02:05.252441 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.252362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vct4t" event={"ID":"7619f76c-58dc-4b2a-a6e6-6af8fd03370a","Type":"ContainerStarted","Data":"3c5635c43d7a86fc3bf41df92a465702ab21c956b7ebce3e3024961b3509e873"} Sep 11 02:02:05.262183 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.262116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" event={"ID":"8aad02c598c34e433b851df1c8655299","Type":"ContainerStarted","Data":"48b8b2f24b133d8dd72fc899d6be3af93deb6e25c92c4bab28e211e3754bcae8"} Sep 11 02:02:05.271120 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.271027 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjb6d" event={"ID":"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53","Type":"ContainerStarted","Data":"1ab6f54d2e7699da1fde2cce596b99ca6c4573241c127496ac5973e58b6f4a9e"} Sep 11 02:02:05.289129 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.289033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" event={"ID":"f7657b76-defd-4c3c-9162-fa0f8a7584cd","Type":"ContainerStarted","Data":"f08bca3489c498e78748065184377248b51c457de553edf164cbc471e1397535"} Sep 11 02:02:05.304833 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.304794 2581 generic.go:356] "Generic (PLEG): container finished" podID="4906ce7cee97908c4a87e7928af19d55" containerID="6d8b77b539be6c53006d1c79c90ce8ec6c0e61d544e7d52718c80be69686f2a6" exitCode=0 Sep 11 02:02:05.304985 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.304892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" event={"ID":"4906ce7cee97908c4a87e7928af19d55","Type":"ContainerDied","Data":"6d8b77b539be6c53006d1c79c90ce8ec6c0e61d544e7d52718c80be69686f2a6"} Sep 11 02:02:05.315423 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.315389 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerStarted","Data":"76fa40196fe6f5cf2bdae4b174ad81b3bc2f0e9c11ef8de7d89c01bd0682c46c"} Sep 11 02:02:05.322325 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.322253 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-234.ec2.internal" podStartSLOduration=3.322230755 podStartE2EDuration="3.322230755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:05.277010817 +0000 UTC m=+4.553301453" watchObservedRunningTime="2026-09-11 02:02:05.322230755 +0000 UTC m=+4.598521351" Sep 11 02:02:05.336758 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.336721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28wk7" event={"ID":"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17","Type":"ContainerStarted","Data":"ecf54e353a0b9e924670194d8725d02f0dbf3bb66ac7cf97af70f12187ffc381"} Sep 11 02:02:05.348820 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.348730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9t7hm" event={"ID":"6df07efe-e751-402d-b58f-4cb3e546de3c","Type":"ContainerStarted","Data":"d20ce68e348ac4a80d9344292de825ee5c0400db1eafcf4e23f2544222dc4734"} Sep 11 02:02:05.362769 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:05.362731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m8dz7" event={"ID":"520b9582-76ab-4ffe-9a50-508d573b7307","Type":"ContainerStarted","Data":"a3a340ef3828aca04f33cbcfdb899dffcceb0fe31535a242a54e2629de167e8f"} Sep 11 02:02:06.402515 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:06.401833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" event={"ID":"4906ce7cee97908c4a87e7928af19d55","Type":"ContainerStarted","Data":"dd93e23105bb62ea3fade78c07d93d50d2b6616ec6e7fdf5eb53373ecdca7514"} Sep 11 02:02:06.768256 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:06.768160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:06.768497 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.768373 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:06.768497 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.768399 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:06.768497 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.768413 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:06.768497 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.768479 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:10.768458652 +0000 UTC m=+10.044749249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:06.868607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:06.868719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.868848 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.868914 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:10.868894574 +0000 UTC m=+10.145185154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.869361 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:06.869528 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:06.869418 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:10.869400219 +0000 UTC m=+10.145690805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:07.216076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:07.216216 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:07.216634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:07.216729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:07.216795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:07.217013 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:07.216885 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:09.214157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:09.214118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:09.214708 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:09.214278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:09.214708 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:09.214372 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:09.214708 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:09.214272 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:09.214708 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:09.214118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:09.214708 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:09.214465 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:10.804869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:10.804208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:10.804869 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.804427 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:10.804869 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.804447 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:10.804869 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.804461 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:10.804869 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.804517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:18.804499268 +0000 UTC m=+18.080789842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:10.905456 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:10.905402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:10.905655 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:10.905469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:10.905655 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.905582 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:10.905655 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.905645 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:10.905790 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.905669 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:18.905648405 +0000 UTC m=+18.181938996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:10.905790 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:10.905726 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:18.905687737 +0000 UTC m=+18.181978325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:11.214133 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:11.214043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:11.214312 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:11.214173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:11.214312 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:11.214184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:11.214418 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:11.214305 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:11.214418 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:11.214348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:11.214503 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:11.214454 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:13.214244 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:13.214155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:13.214244 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:13.214155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:13.214695 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:13.214310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:13.214695 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:13.214363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:13.214695 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:13.214155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:13.214695 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:13.214459 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:15.213431 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:15.213394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:15.213870 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:15.213394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:15.213870 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:15.213527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:15.213870 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:15.213527 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:15.213870 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:15.213649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:15.213870 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:15.213741 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:17.213519 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:17.213480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:17.213970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:17.213529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:17.213970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:17.213482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:17.213970 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:17.213611 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:17.213970 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:17.213663 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:17.213970 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:17.213745 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:18.864116 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:18.864072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:18.864592 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.864241 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:18.864592 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.864263 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:18.864592 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.864277 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:18.864592 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.864336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:34.86432288 +0000 UTC m=+34.140613450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:18.965086 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:18.965052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:18.965267 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:18.965099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:18.965267 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.965210 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:18.965267 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.965237 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:18.965422 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.965279 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:34.965259945 +0000 UTC m=+34.241550517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:18.965422 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:18.965294 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:34.965287526 +0000 UTC m=+34.241578096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:19.213564 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:19.213393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:19.213564 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:19.213524 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:19.213770 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:19.213593 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:19.213770 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:19.213596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:19.213770 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:19.213696 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:19.213911 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:19.213785 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:21.213690 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:21.213663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:21.214128 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:21.213772 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:21.214128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:21.213822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:21.214128 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:21.213900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:21.214128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:21.213924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:21.214128 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:21.214046 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:23.214349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.213852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:23.215635 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.213864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:23.215635 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:23.214418 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:23.215635 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.213916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:23.215635 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:23.214508 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:23.215635 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:23.214575 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:23.446591 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.446547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" event={"ID":"f7657b76-defd-4c3c-9162-fa0f8a7584cd","Type":"ContainerStarted","Data":"8224030f97828ac901a2997ead6d302acb96fb3a9800440804168a55ddcbe3a6"} Sep 11 02:02:23.448153 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.448125 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="6824be3fbf11c0886431d03e60db776362d79a712890561ad59e6d080346fe66" exitCode=0 Sep 11 02:02:23.448272 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.448215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"6824be3fbf11c0886431d03e60db776362d79a712890561ad59e6d080346fe66"} Sep 11 02:02:23.449892 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.449823 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28wk7" event={"ID":"c28c23d5-02c5-4df0-8fcc-765bfcbe1f17","Type":"ContainerStarted","Data":"719af598dbc80dd7d715f7a27f1821eb9cad466a68925182942856506a3ce7cc"} Sep 11 02:02:23.451554 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.451533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9t7hm" event={"ID":"6df07efe-e751-402d-b58f-4cb3e546de3c","Type":"ContainerStarted","Data":"f5a5cb534ba8609ba9d1b3f199ef312f4bcdcbc5202f39290c54fda462cfc134"} Sep 11 02:02:23.453318 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.453229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m8dz7" event={"ID":"520b9582-76ab-4ffe-9a50-508d573b7307","Type":"ContainerStarted","Data":"6a1562cdaca8fff780b929839b87aa35f66878440a9684b13a08576ea823a6ec"} Sep 11 02:02:23.456807 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.456787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"6d3dcf3d5eeb497174a1fef26b861b962a9020853a06b3f732998de52c6f74c1"} Sep 11 02:02:23.456911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.456857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"bb5d8d314bfb64d47715be8d766df2b7acaa8189f0e87051f49304a6a92741e2"} Sep 11 02:02:23.456973 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.456908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"431842a8b280255601bc297064690fe2d231be4a310c64e7dde4130c58dd1788"} Sep 11 02:02:23.457048 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.456998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"01750aa4a38c8e3f26dca5bcc220408526e3861bce3df6eab0df13443d9b150c"} Sep 11 02:02:23.457103 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.457046 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"3cea803301f0230b801747529f8dbde11ff11292bdd1df4d0f1394d2e563d7fc"} Sep 11 02:02:23.457103 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.457088 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"ee66dcc75f06ad7563ca2795d3aeefa6f3c8963cc4fa9b93e7154a79da71bd3b"} Sep 11 02:02:23.458417 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.458399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fhs86" event={"ID":"10034a0c-3f07-4f9f-8693-5cde30aa7ba6","Type":"ContainerStarted","Data":"484b5956e05cdfcbccbe8d38e6e619fe0d171825eba0226a8b0eae8b5f6b154e"} Sep 11 02:02:23.460027 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.460005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vct4t" event={"ID":"7619f76c-58dc-4b2a-a6e6-6af8fd03370a","Type":"ContainerStarted","Data":"14b67474f90fe934ffa7fd19b9f7b30a9c00c7e740e48a75ad2df2644ccd0a0a"} Sep 11 02:02:23.467253 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.467141 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-234.ec2.internal" podStartSLOduration=20.467129205 podStartE2EDuration="20.467129205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:06.41916022 +0000 UTC m=+5.695450834" watchObservedRunningTime="2026-09-11 02:02:23.467129205 +0000 UTC m=+22.743419797" Sep 11 02:02:23.481265 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.481217 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vct4t" podStartSLOduration=3.453617221 podStartE2EDuration="21.481201731s" totalImagesPullingTime="18.02758451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:23.481093431 +0000 UTC m=+22.757384044" watchObservedRunningTime="2026-09-11 02:02:23.481201731 +0000 UTC m=+22.757492322" Sep 11 02:02:23.493118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.493079 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fhs86" podStartSLOduration=4.487923909 podStartE2EDuration="22.493065755s" totalImagesPullingTime="18.005141846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:23.49297792 +0000 UTC m=+22.769268530" watchObservedRunningTime="2026-09-11 02:02:23.493065755 +0000 UTC m=+22.769356345" Sep 11 02:02:23.505056 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.505000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-28wk7" podStartSLOduration=3.533907719 podStartE2EDuration="21.50496546s" totalImagesPullingTime="17.971057741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:23.504741503 +0000 UTC m=+22.781032121" watchObservedRunningTime="2026-09-11 02:02:23.50496546 +0000 UTC m=+22.781256053" Sep 11 02:02:23.517420 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.517367 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m8dz7" podStartSLOduration=3.54196777 podStartE2EDuration="21.517352568s" totalImagesPullingTime="17.975384798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:23.517034826 +0000 UTC m=+22.793325447" watchObservedRunningTime="2026-09-11 02:02:23.517352568 +0000 UTC m=+22.793643166" Sep 11 02:02:23.535950 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:23.535883 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9t7hm" podStartSLOduration=3.469479587 podStartE2EDuration="21.535860711s" totalImagesPullingTime="18.066381124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:23.53579728 +0000 UTC m=+22.812087892" watchObservedRunningTime="2026-09-11 02:02:23.535860711 +0000 UTC m=+22.812151305" Sep 11 02:02:24.005945 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.005921 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 02:02:24.204302 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.204124 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T02:02:24.005942535Z","UUID":"6d115ec6-1910-4322-a301-0296a94e8b75","Handler":null,"Name":"","Endpoint":""} Sep 11 02:02:24.205938 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.205920 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 02:02:24.206191 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.205953 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 02:02:24.464644 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.464545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjb6d" event={"ID":"9c477cfd-d3ea-479c-a95c-a6f8ab23bc53","Type":"ContainerStarted","Data":"60ad8067436e4516f3203ab79240526ffc81b59951f158c17b3c1dead9e71c46"} Sep 11 02:02:24.466814 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:24.466785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" event={"ID":"f7657b76-defd-4c3c-9162-fa0f8a7584cd","Type":"ContainerStarted","Data":"1b0bec01fbf35ee785ca24322601b2dd91f94a64fed4aa72044aa48bbefb384d"} Sep 11 02:02:25.213659 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.213628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:25.213789 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.213639 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:25.213789 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.213783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:25.213906 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:25.213784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:25.213906 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:25.213871 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:25.214044 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:25.213974 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:25.474613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.474511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" event={"ID":"f7657b76-defd-4c3c-9162-fa0f8a7584cd","Type":"ContainerStarted","Data":"12e75c3765d4f9020c9a7ac8e07f294d86d98dcb7250905e704daa3aa8f1e713"} Sep 11 02:02:25.478753 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.478718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"01adff22357c93d8177be084de54a91ca7617033c4f7b63299fc780529b39aab"} Sep 11 02:02:25.490998 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.490930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wjb6d" podStartSLOduration=5.491426794 podStartE2EDuration="23.490915124s" totalImagesPullingTime="17.99948833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:24.47710726 +0000 UTC m=+23.753397878" watchObservedRunningTime="2026-09-11 02:02:25.490915124 +0000 UTC m=+24.767205725" Sep 11 02:02:25.491271 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:25.491244 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5ktl" podStartSLOduration=4.093351452 podStartE2EDuration="24.491234918s" totalImagesPullingTime="20.397883466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:25.49071789 +0000 UTC m=+24.767008502" watchObservedRunningTime="2026-09-11 02:02:25.491234918 +0000 UTC m=+24.767525509" Sep 11 02:02:26.987095 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:26.987066 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:26.987673 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:26.987653 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:27.213439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:27.213387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:27.213439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:27.213418 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:27.213439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:27.213387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:27.213715 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:27.213513 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:27.213715 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:27.213555 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:27.213715 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:27.213649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:27.482976 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:27.482885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:27.483382 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:27.483364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m8dz7" Sep 11 02:02:28.487084 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.487038 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="1b14e0765c3c29f55ff02363b6bb928b1c9fa87e3734f5dfb5e3c7cf65e46ab4" exitCode=0 Sep 11 02:02:28.488101 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.487123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"1b14e0765c3c29f55ff02363b6bb928b1c9fa87e3734f5dfb5e3c7cf65e46ab4"} Sep 11 02:02:28.490924 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.490897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" event={"ID":"2eb436f4-fe67-4f6e-a922-5249b835f447","Type":"ContainerStarted","Data":"b198de4dba1526701019becff047270954b849d2939bd0413b2f86e66dc4b661"} Sep 11 02:02:28.491245 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.491222 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:28.491354 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.491297 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:28.507432 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.507409 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:28.528290 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:28.528240 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" podStartSLOduration=8.462163997 podStartE2EDuration="26.528221594s" totalImagesPullingTime="18.066057597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:28.527629914 +0000 UTC m=+27.803920530" watchObservedRunningTime="2026-09-11 02:02:28.528221594 +0000 UTC m=+27.804512185" Sep 11 02:02:29.214181 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.213843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:29.214412 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.213843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:29.214412 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.214302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:29.214527 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.213844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:29.214527 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.214457 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:29.214527 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.214514 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:29.493194 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.493167 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:29.508237 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.508212 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:02:29.555603 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.555572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8vrxg"] Sep 11 02:02:29.555742 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.555729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:29.555852 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.555831 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:29.558519 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.558496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mtjkg"] Sep 11 02:02:29.558673 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.558614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:29.558727 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.558710 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:29.570886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.570861 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2nb5"] Sep 11 02:02:29.571121 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:29.571107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:29.571213 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:29.571197 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:30.497278 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:30.497244 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="9f53b270fb9521a32a05460a39366abebdd58ade9211a662445b2c02f9d50325" exitCode=0 Sep 11 02:02:30.497722 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:30.497322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"9f53b270fb9521a32a05460a39366abebdd58ade9211a662445b2c02f9d50325"} Sep 11 02:02:31.214065 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:31.214036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:31.214241 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:31.214148 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:31.214241 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:31.214184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:31.214357 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:31.214303 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:31.214357 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:31.214324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:31.214477 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:31.214439 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:31.501558 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:31.501469 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="60b855e3235ba6423b7659dade3a34e5a704bd2f3215b025804780bb70a823f7" exitCode=0 Sep 11 02:02:31.501907 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:31.501551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"60b855e3235ba6423b7659dade3a34e5a704bd2f3215b025804780bb70a823f7"} Sep 11 02:02:33.213800 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:33.213549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:33.214266 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:33.213554 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:33.214266 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:33.213910 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:33.214266 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:33.213554 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:33.214266 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:33.214074 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:33.214266 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:33.214168 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:34.880181 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:34.880144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:34.880694 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.880301 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:02:34.880694 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.880328 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:02:34.880694 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.880341 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sqlr7 for pod openshift-network-diagnostics/network-check-target-g2nb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:34.880694 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.880407 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7 podName:afa90ece-d170-496d-ad54-fea89a85c403 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:06.880388159 +0000 UTC m=+66.156678737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqlr7" (UniqueName: "kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7") pod "network-check-target-g2nb5" (UID: "afa90ece-d170-496d-ad54-fea89a85c403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:02:34.981439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:34.981398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:34.981636 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:34.981454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:34.981636 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.981562 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:34.981636 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.981595 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:34.981763 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.981642 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret podName:db0071c5-7ec4-407d-860c-2272d7a8e461 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:06.981626628 +0000 UTC m=+66.257917198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret") pod "global-pull-secret-syncer-8vrxg" (UID: "db0071c5-7ec4-407d-860c-2272d7a8e461") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:02:34.981763 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:34.981658 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs podName:95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:06.981651529 +0000 UTC m=+66.257942099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs") pod "network-metrics-daemon-mtjkg" (UID: "95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:02:35.214043 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.213950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:35.214043 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.213974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:35.214261 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.214091 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2nb5" podUID="afa90ece-d170-496d-ad54-fea89a85c403" Sep 11 02:02:35.214261 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.214185 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vrxg" podUID="db0071c5-7ec4-407d-860c-2272d7a8e461" Sep 11 02:02:35.214261 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.214218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:35.214417 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.214330 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtjkg" podUID="95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51" Sep 11 02:02:35.525593 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.525514 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-234.ec2.internal" event="NodeReady" Sep 11 02:02:35.525745 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.525662 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 02:02:35.552372 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.552340 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-586cf6fc66-t4lsp"] Sep 11 02:02:35.586104 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.585670 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xspsb"] Sep 11 02:02:35.586104 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.585691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.588333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.588308 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 02:02:35.588333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.588320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 02:02:35.588481 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.588367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8c7k\"" Sep 11 02:02:35.588515 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.588504 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 02:02:35.592962 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.592936 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 02:02:35.600148 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.599506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l69lk"] Sep 11 02:02:35.600298 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.600278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.602765 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.602746 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 02:02:35.602890 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.602751 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 02:02:35.602890 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.602768 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-csxtn\"" Sep 11 02:02:35.614832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.614790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-586cf6fc66-t4lsp"] Sep 11 02:02:35.614970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.614850 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xspsb"] Sep 11 02:02:35.614970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.614886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l69lk"] Sep 11 02:02:35.615104 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.614970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.617118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.617100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8mj8f\"" Sep 11 02:02:35.617118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.617116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 02:02:35.617267 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.617152 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 02:02:35.617355 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.617341 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 02:02:35.686254 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrpk\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686254 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvlv5\" (UniqueName: \"kubernetes.io/projected/331f2a9b-8830-48f9-80da-400d95541e68-kube-api-access-qvlv5\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/331f2a9b-8830-48f9-80da-400d95541e68-tmp-dir\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/331f2a9b-8830-48f9-80da-400d95541e68-config-volume\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.686450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.686653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.686653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.686508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.787543 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrpk\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.787543 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvlv5\" (UniqueName: \"kubernetes.io/projected/331f2a9b-8830-48f9-80da-400d95541e68-kube-api-access-qvlv5\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.787543 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/388aad7c-68ef-4b0f-84a3-f215d12e6301-cert\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.787739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9jdq\" (UniqueName: \"kubernetes.io/projected/388aad7c-68ef-4b0f-84a3-f215d12e6301-kube-api-access-m9jdq\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.787739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.787739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.787839 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.787839 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/331f2a9b-8830-48f9-80da-400d95541e68-tmp-dir\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.787937 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.787852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788030 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/331f2a9b-8830-48f9-80da-400d95541e68-config-volume\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.788089 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788045 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.788141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788241 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788241 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/331f2a9b-8830-48f9-80da-400d95541e68-tmp-dir\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.788340 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.788318 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:35.788340 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.788333 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:35.788446 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.788381 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:36.28836578 +0000 UTC m=+35.564656363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:35.788446 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.788442 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:35.788551 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:35.788474 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:36.288463558 +0000 UTC m=+35.564754132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:35.788551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/331f2a9b-8830-48f9-80da-400d95541e68-config-volume\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.788551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.788903 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.788886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.793048 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.793024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.793164 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.793024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.796552 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.796515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.796742 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.796706 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvlv5\" (UniqueName: \"kubernetes.io/projected/331f2a9b-8830-48f9-80da-400d95541e68-kube-api-access-qvlv5\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:35.796873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.796854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrpk\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:35.889342 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.889305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/388aad7c-68ef-4b0f-84a3-f215d12e6301-cert\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.889342 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.889341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9jdq\" (UniqueName: \"kubernetes.io/projected/388aad7c-68ef-4b0f-84a3-f215d12e6301-kube-api-access-m9jdq\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.891680 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.891661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/388aad7c-68ef-4b0f-84a3-f215d12e6301-cert\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.897295 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.897270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9jdq\" (UniqueName: \"kubernetes.io/projected/388aad7c-68ef-4b0f-84a3-f215d12e6301-kube-api-access-m9jdq\") pod \"ingress-canary-l69lk\" (UID: \"388aad7c-68ef-4b0f-84a3-f215d12e6301\") " pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:35.922423 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:35.922386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l69lk" Sep 11 02:02:36.292591 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.292403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:36.292722 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.292610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:36.292722 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:36.292554 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:36.292722 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:36.292697 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:36.292722 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:36.292706 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:37.292686718 +0000 UTC m=+36.568977293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:36.292722 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:36.292708 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:36.292888 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:36.292737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:37.292730627 +0000 UTC m=+36.569021196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:36.341805 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.341777 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l69lk"] Sep 11 02:02:36.364913 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:02:36.364880 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388aad7c_68ef_4b0f_84a3_f215d12e6301.slice/crio-6447166391a594dc3f25f4e4b567657ea8d658716a62c3f16dc6b372b0cf5fca WatchSource:0}: Error finding container 6447166391a594dc3f25f4e4b567657ea8d658716a62c3f16dc6b372b0cf5fca: Status 404 returned error can't find the container with id 6447166391a594dc3f25f4e4b567657ea8d658716a62c3f16dc6b372b0cf5fca Sep 11 02:02:36.515462 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.515420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l69lk" event={"ID":"388aad7c-68ef-4b0f-84a3-f215d12e6301","Type":"ContainerStarted","Data":"6447166391a594dc3f25f4e4b567657ea8d658716a62c3f16dc6b372b0cf5fca"} Sep 11 02:02:36.518282 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.518245 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="2e47926e2d3f5327458a3aabb3813d15dbe70edc8bda8dc74d35851ef4949094" exitCode=0 Sep 11 02:02:36.518406 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.518308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"2e47926e2d3f5327458a3aabb3813d15dbe70edc8bda8dc74d35851ef4949094"} Sep 11 02:02:36.798534 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.798500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:36.878226 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:36.878145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:37.213712 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.213635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:02:37.214220 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.213635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:02:37.214220 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.213634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:02:37.216240 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:02:37.216383 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216292 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:02:37.216383 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwm26\"" Sep 11 02:02:37.216383 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:02:37.216535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rmxvk\"" Sep 11 02:02:37.216535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.216444 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:02:37.300704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.300667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:37.300886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.300724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:37.300886 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:37.300850 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:37.300886 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:37.300864 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:37.301061 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:37.300890 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:37.301061 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:37.300930 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:39.300910793 +0000 UTC m=+38.577201377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:37.301061 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:37.300949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:39.30093954 +0000 UTC m=+38.577230114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:37.524454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.524368 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef36f517-4baf-4369-bb25-1c7cd86cf177" containerID="81fa3a5dbb65a9aba98cf4d730926bf9781bfab74d828fb3a78b7792fc8ff70a" exitCode=0 Sep 11 02:02:37.524454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:37.524436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerDied","Data":"81fa3a5dbb65a9aba98cf4d730926bf9781bfab74d828fb3a78b7792fc8ff70a"} Sep 11 02:02:38.531413 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:38.531374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" event={"ID":"ef36f517-4baf-4369-bb25-1c7cd86cf177","Type":"ContainerStarted","Data":"c8674704dfa691b551b0df248f45c99736229e8b0cc147918ed84174e020e347"} Sep 11 02:02:38.550859 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:38.550809 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n9r9k" podStartSLOduration=8.140087477 podStartE2EDuration="36.550788886s" totalImagesPullingTime="28.410701409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:38.549552916 +0000 UTC m=+37.825843527" watchObservedRunningTime="2026-09-11 02:02:38.550788886 +0000 UTC m=+37.827079480" Sep 11 02:02:38.668759 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:38.668699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:38.730687 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:38.730643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:38.824287 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:38.824247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:39.317017 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:39.316735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:39.317193 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:39.317048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:39.317193 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:39.316884 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:39.317193 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:39.317154 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:43.317131599 +0000 UTC m=+42.593422187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:39.317193 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:39.317187 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:39.317404 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:39.317202 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:39.317404 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:39.317257 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:43.317239558 +0000 UTC m=+42.593530132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:39.535583 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:39.535493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l69lk" event={"ID":"388aad7c-68ef-4b0f-84a3-f215d12e6301","Type":"ContainerStarted","Data":"e3a260e7282ab0b1406314265ee03bcc0ff390f1543a8a4cf09d2bb9a6f47876"} Sep 11 02:02:39.549966 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:39.549915 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l69lk" podStartSLOduration=1.769262612 podStartE2EDuration="4.54989964s" totalImagesPullingTime="2.780637028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:02:39.54888563 +0000 UTC m=+38.825176234" watchObservedRunningTime="2026-09-11 02:02:39.54989964 +0000 UTC m=+38.826190226" Sep 11 02:02:40.424176 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.424140 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9"] Sep 11 02:02:40.448413 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.448379 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9"] Sep 11 02:02:40.448537 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.448478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.450764 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.450733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 11 02:02:40.450910 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.450808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zn2f7\"" Sep 11 02:02:40.451546 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.451528 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 11 02:02:40.562313 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.562281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:40.627446 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.627412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/922b8481-0ae5-4736-a017-64809c5c02ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.627617 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.627470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.658429 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.658393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:40.728694 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.728605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/922b8481-0ae5-4736-a017-64809c5c02ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.728694 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.728656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.728882 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:40.728830 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:40.728918 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:40.728895 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:02:41.228879218 +0000 UTC m=+40.505169788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:40.729337 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.729320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/922b8481-0ae5-4736-a017-64809c5c02ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:40.759584 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.759546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:40.859065 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.859025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:40.957036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:40.956979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:41.233262 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:41.233228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:41.233476 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:41.233333 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:41.233476 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:41.233387 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:02:42.233370692 +0000 UTC m=+41.509661282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:42.239886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:42.239844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:42.240530 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:42.240054 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:42.240530 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:42.240140 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:02:44.240120647 +0000 UTC m=+43.516411217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:42.888217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:42.888178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:42.988634 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:42.988600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.089468 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.089423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.190699 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.190626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.250748 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.250716 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pncjc"] Sep 11 02:02:43.272467 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.272430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.272616 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.272492 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pncjc"] Sep 11 02:02:43.272616 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.272575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.274759 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.274731 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 02:02:43.274759 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.274731 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 02:02:43.274952 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.274789 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 02:02:43.274952 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.274812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbvst\"" Sep 11 02:02:43.275559 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.275544 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 02:02:43.348518 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.348485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:43.348712 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.348568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:43.348712 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.348648 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:43.348712 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.348673 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:43.348874 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.348650 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:43.348874 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.348744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:51.34872372 +0000 UTC m=+50.625014293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:43.348874 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.348790 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:02:51.348775874 +0000 UTC m=+50.625066443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:43.424486 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.424446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.449503 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.449408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cdfbc10-5679-4d50-92f5-c06b3ba841be-crio-socket\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.449503 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.449466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.449701 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.449526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cdfbc10-5679-4d50-92f5-c06b3ba841be-data-volume\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.449701 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.449555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.449701 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.449573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jgm7\" (UniqueName: \"kubernetes.io/projected/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-api-access-9jgm7\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.524551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.524522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.550439 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cdfbc10-5679-4d50-92f5-c06b3ba841be-crio-socket\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550605 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550605 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cdfbc10-5679-4d50-92f5-c06b3ba841be-data-volume\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550605 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.550546 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 02:02:43.550605 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550615 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cdfbc10-5679-4d50-92f5-c06b3ba841be-crio-socket\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.550625 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:44.05060816 +0000 UTC m=+43.326898730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : configmap "kube-rbac-proxy" not found Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jgm7\" (UniqueName: \"kubernetes.io/projected/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-api-access-9jgm7\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.550699 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:43.550763 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:44.050745996 +0000 UTC m=+43.327036581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : secret "insights-runtime-extractor-tls" not found Sep 11 02:02:43.550775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.550769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cdfbc10-5679-4d50-92f5-c06b3ba841be-data-volume\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.563198 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.563173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jgm7\" (UniqueName: \"kubernetes.io/projected/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-api-access-9jgm7\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:43.712134 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.712040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:43.767400 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:43.767361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:44.054157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:44.054073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:44.054157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:44.054116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:44.054339 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.054208 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 02:02:44.054339 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.054233 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 02:02:44.054339 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.054277 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:45.054258229 +0000 UTC m=+44.330548809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : configmap "kube-rbac-proxy" not found Sep 11 02:02:44.054339 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.054293 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:45.05428481 +0000 UTC m=+44.330575383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : secret "insights-runtime-extractor-tls" not found Sep 11 02:02:44.255273 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:44.255229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:44.255683 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.255383 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:44.255683 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:44.255463 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:02:48.255445894 +0000 UTC m=+47.531736464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:44.843583 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:44.843542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:44.909639 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:44.909602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:45.010288 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.010251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:45.022086 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.022062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28wk7_c28c23d5-02c5-4df0-8fcc-765bfcbe1f17/dns-node-resolver/0.log" Sep 11 02:02:45.061974 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.061940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:45.062159 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.062001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:45.062159 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:45.062066 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 02:02:45.062159 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:45.062137 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:47.062121869 +0000 UTC m=+46.338412440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : configmap "kube-rbac-proxy" not found Sep 11 02:02:45.062287 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:45.062159 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 02:02:45.062287 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:45.062203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:47.062191223 +0000 UTC m=+46.338481793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : secret "insights-runtime-extractor-tls" not found Sep 11 02:02:45.352880 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.352838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:45.402632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:45.402596 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:46.256443 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:46.256408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:46.423451 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:46.423424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fhs86_10034a0c-3f07-4f9f-8693-5cde30aa7ba6/node-ca/0.log" Sep 11 02:02:47.000723 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:47.000690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:47.024124 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:47.024099 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l69lk_388aad7c-68ef-4b0f-84a3-f215d12e6301/serve-healthcheck-canary/0.log" Sep 11 02:02:47.075528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:47.075495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:47.075528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:47.075532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:47.075704 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:47.075622 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 02:02:47.075704 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:47.075686 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 02:02:47.075779 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:47.075691 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:51.075673286 +0000 UTC m=+50.351963856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : configmap "kube-rbac-proxy" not found Sep 11 02:02:47.075779 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:47.075740 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:51.075724382 +0000 UTC m=+50.352014952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : secret "insights-runtime-extractor-tls" not found Sep 11 02:02:47.101430 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:47.101398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:48.211294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:48.211259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:48.283391 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:48.283348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:48.283606 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:48.283499 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:48.283606 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:48.283566 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:02:56.283550191 +0000 UTC m=+55.559840760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:48.668501 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:48.668448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:48.719727 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:48.719686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:49.012272 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:49.012168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:50.322775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:50.322741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:50.633500 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:50.633415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:50.821579 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:50.821548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:50.921817 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:50.921731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:51.021898 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.021851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:51.103976 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.103932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:51.104165 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.104003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:51.104165 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.104108 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 02:02:51.104251 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.104174 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls podName:0cdfbc10-5679-4d50-92f5-c06b3ba841be nodeName:}" failed. No retries permitted until 2026-09-11 02:02:59.104158571 +0000 UTC m=+58.380449142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pncjc" (UID: "0cdfbc10-5679-4d50-92f5-c06b3ba841be") : secret "insights-runtime-extractor-tls" not found Sep 11 02:02:51.104508 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.104491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cdfbc10-5679-4d50-92f5-c06b3ba841be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:51.122260 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.122225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:51.406421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.406386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.406457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.406543 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.406611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls podName:331f2a9b-8830-48f9-80da-400d95541e68 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:07.406596373 +0000 UTC m=+66.682886949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls") pod "dns-default-xspsb" (UID: "331f2a9b-8830-48f9-80da-400d95541e68") : secret "dns-default-metrics-tls" not found Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.406547 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.406642 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-586cf6fc66-t4lsp: secret "image-registry-tls" not found Sep 11 02:02:51.406824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:51.406674 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls podName:7e494738-1afc-437c-a77b-8426d805d0e4 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:07.406664528 +0000 UTC m=+66.682955105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls") pod "image-registry-586cf6fc66-t4lsp" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4") : secret "image-registry-tls" not found Sep 11 02:02:51.828189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:51.828152 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:52.234204 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:52.234121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:52.387710 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:52.387677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:52.630752 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:52.630713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:52.824858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:52.824821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:53.034886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:53.034804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:53.427832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:53.427792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:53.825285 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:53.825252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:54.017376 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:54.017336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:54.071419 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:54.071381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:54.428252 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:54.428213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:54.489690 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:54.489657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:55.030062 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:55.030030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:55.125564 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:55.125527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:55.427222 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:55.427187 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:55.826148 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:55.826117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:56.230000 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:56.229887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:56.345164 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:56.345130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:02:56.345278 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:56.345245 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 02:02:56.345327 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:02:56.345304 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert podName:922b8481-0ae5-4736-a017-64809c5c02ba nodeName:}" failed. No retries permitted until 2026-09-11 02:03:12.345291304 +0000 UTC m=+71.621581874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bv2c9" (UID: "922b8481-0ae5-4736-a017-64809c5c02ba") : secret "networking-console-plugin-cert" not found Sep 11 02:02:56.625961 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:56.625925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:56.823704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:56.823671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:57.227678 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:57.227642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:57.548097 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:57.548015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:57.648369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:57.648334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:58.447491 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:58.447453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:58.631794 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:58.631762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:58.825066 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:58.825033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:59.027921 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.027875 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:02:59.165452 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.165372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:59.167633 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.167614 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cdfbc10-5679-4d50-92f5-c06b3ba841be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pncjc\" (UID: \"0cdfbc10-5679-4d50-92f5-c06b3ba841be\") " pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:59.181633 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.181604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pncjc" Sep 11 02:02:59.482792 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.482720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pncjc"] Sep 11 02:02:59.586244 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:02:59.586207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pncjc" event={"ID":"0cdfbc10-5679-4d50-92f5-c06b3ba841be","Type":"ContainerStarted","Data":"1fec55054af093de9f666acc92c12b4cce8dfc94d517208efaff3a6719e42e17"} Sep 11 02:03:00.024280 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.024230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:00.434176 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.434133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:00.591114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.591083 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pncjc" event={"ID":"0cdfbc10-5679-4d50-92f5-c06b3ba841be","Type":"ContainerStarted","Data":"edcfb16dfcfa43188abd50123318ff11989db72aa32559903df41a24a2c482d5"} Sep 11 02:03:00.591267 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.591137 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pncjc" event={"ID":"0cdfbc10-5679-4d50-92f5-c06b3ba841be","Type":"ContainerStarted","Data":"e3278e422886b15acedd4a9fa8da2d75f61a9196e84314042db81b2f541fef14"} Sep 11 02:03:00.631787 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.631750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:00.831576 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:00.831520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:01.035896 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:01.035757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:01.514058 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:01.514031 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbmv" Sep 11 02:03:02.598322 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:02.598289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pncjc" event={"ID":"0cdfbc10-5679-4d50-92f5-c06b3ba841be","Type":"ContainerStarted","Data":"f650fd6749293e81473d6e19acd4118d405d88e411e68ee5e9057e475cc18a12"} Sep 11 02:03:02.614327 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:02.614279 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pncjc" podStartSLOduration=17.385535419 podStartE2EDuration="19.614261937s" totalImagesPullingTime="2.228726518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:02.613208227 +0000 UTC m=+61.889498963" watchObservedRunningTime="2026-09-11 02:03:02.614261937 +0000 UTC m=+61.890552529" Sep 11 02:03:06.927062 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:06.927018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:03:06.929366 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:06.929349 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:03:06.939073 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:06.939056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:03:06.950258 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:06.950235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqlr7\" (UniqueName: \"kubernetes.io/projected/afa90ece-d170-496d-ad54-fea89a85c403-kube-api-access-sqlr7\") pod \"network-check-target-g2nb5\" (UID: \"afa90ece-d170-496d-ad54-fea89a85c403\") " pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:03:07.028091 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.028046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:03:07.028091 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.028095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:03:07.030727 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.030703 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:03:07.030848 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.030796 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:03:07.041513 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.041484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db0071c5-7ec4-407d-860c-2272d7a8e461-original-pull-secret\") pod \"global-pull-secret-syncer-8vrxg\" (UID: \"db0071c5-7ec4-407d-860c-2272d7a8e461\") " pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:03:07.041622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.041484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51-metrics-certs\") pod \"network-metrics-daemon-mtjkg\" (UID: \"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51\") " pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:03:07.208647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.208561 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-586cf6fc66-t4lsp"] Sep 11 02:03:07.208791 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:03:07.208772 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" podUID="7e494738-1afc-437c-a77b-8426d805d0e4" Sep 11 02:03:07.222100 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.222062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m"] Sep 11 02:03:07.224590 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.224569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.225102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.225083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwm26\"" Sep 11 02:03:07.226590 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.226560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 02:03:07.226590 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.226587 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 02:03:07.226739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.226591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 11 02:03:07.226739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.226654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 02:03:07.228701 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.228683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vrxg" Sep 11 02:03:07.230000 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.229971 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst"] Sep 11 02:03:07.231845 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.231828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.233310 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.233288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtjkg" Sep 11 02:03:07.245747 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.245706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m"] Sep 11 02:03:07.247578 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.247547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 11 02:03:07.247693 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.247673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rmxvk\"" Sep 11 02:03:07.248675 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.248657 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 11 02:03:07.248811 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.248793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 11 02:03:07.248873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.248820 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 11 02:03:07.255149 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.255120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:03:07.282604 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.282538 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst"] Sep 11 02:03:07.331651 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.331761 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.331761 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.331761 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6840c87a-9441-436b-9588-ccd44ff16672-tmp\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.331935 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1348c7f2-e614-4ac9-995b-7fa737a78e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.331935 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.331935 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cfcn\" (UniqueName: \"kubernetes.io/projected/6840c87a-9441-436b-9588-ccd44ff16672-kube-api-access-6cfcn\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.332109 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.331960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6840c87a-9441-436b-9588-ccd44ff16672-klusterlet-config\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.332109 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.332006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzz6q\" (UniqueName: \"kubernetes.io/projected/1348c7f2-e614-4ac9-995b-7fa737a78e77-kube-api-access-xzz6q\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.340934 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.340900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:07.418605 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.418566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:07.432664 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cfcn\" (UniqueName: \"kubernetes.io/projected/6840c87a-9441-436b-9588-ccd44ff16672-kube-api-access-6cfcn\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.432773 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6840c87a-9441-436b-9588-ccd44ff16672-klusterlet-config\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.432773 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzz6q\" (UniqueName: \"kubernetes.io/projected/1348c7f2-e614-4ac9-995b-7fa737a78e77-kube-api-access-xzz6q\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.432869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.432869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:03:07.432869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.433069 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.433069 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.432918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:03:07.433180 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.433148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6840c87a-9441-436b-9588-ccd44ff16672-tmp\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.434364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.433224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1348c7f2-e614-4ac9-995b-7fa737a78e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.434364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.433285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.434364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.433606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6840c87a-9441-436b-9588-ccd44ff16672-tmp\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.434364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.434309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1348c7f2-e614-4ac9-995b-7fa737a78e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.435800 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.435766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"image-registry-586cf6fc66-t4lsp\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:03:07.435800 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.435784 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/331f2a9b-8830-48f9-80da-400d95541e68-metrics-tls\") pod \"dns-default-xspsb\" (UID: \"331f2a9b-8830-48f9-80da-400d95541e68\") " pod="openshift-dns/dns-default-xspsb" Sep 11 02:03:07.436015 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.435973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6840c87a-9441-436b-9588-ccd44ff16672-klusterlet-config\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.436108 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.436063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.436225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.436170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-ca\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.436274 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.436258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.436274 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.436261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1348c7f2-e614-4ac9-995b-7fa737a78e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.441743 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.441720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cfcn\" (UniqueName: \"kubernetes.io/projected/6840c87a-9441-436b-9588-ccd44ff16672-kube-api-access-6cfcn\") pod \"klusterlet-addon-workmgr-694c749f87-c7j5m\" (UID: \"6840c87a-9441-436b-9588-ccd44ff16672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.441911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.441894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzz6q\" (UniqueName: \"kubernetes.io/projected/1348c7f2-e614-4ac9-995b-7fa737a78e77-kube-api-access-xzz6q\") pod \"cluster-proxy-proxy-agent-5cd5c97f66-9rvst\" (UID: \"1348c7f2-e614-4ac9-995b-7fa737a78e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.507828 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.507755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8vrxg"] Sep 11 02:03:07.511007 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.510968 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0071c5_7ec4_407d_860c_2272d7a8e461.slice/crio-4fb2c9b55ad3560b0e4968c2f167c39b8cdee64d6f2005ff213a9b47d53fe846 WatchSource:0}: Error finding container 4fb2c9b55ad3560b0e4968c2f167c39b8cdee64d6f2005ff213a9b47d53fe846: Status 404 returned error can't find the container with id 4fb2c9b55ad3560b0e4968c2f167c39b8cdee64d6f2005ff213a9b47d53fe846 Sep 11 02:03:07.514758 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.514738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mtjkg"] Sep 11 02:03:07.516310 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.516281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:07.517867 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.517846 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ffa4b1_80d3_4ff0_92b2_bdbb670dcd51.slice/crio-4ba6f257d05d0c4d6c8dd8254ae077fee0e6e9a6d092234d3a46ca4d1635f05e WatchSource:0}: Error finding container 4ba6f257d05d0c4d6c8dd8254ae077fee0e6e9a6d092234d3a46ca4d1635f05e: Status 404 returned error can't find the container with id 4ba6f257d05d0c4d6c8dd8254ae077fee0e6e9a6d092234d3a46ca4d1635f05e Sep 11 02:03:07.536171 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.536151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:07.544335 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.544312 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2nb5"] Sep 11 02:03:07.547931 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.547899 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa90ece_d170_496d_ad54_fea89a85c403.slice/crio-df80cf12a44c52028f7421c4257465d55e5f83fe538c7b4f153e15748c190afd WatchSource:0}: Error finding container df80cf12a44c52028f7421c4257465d55e5f83fe538c7b4f153e15748c190afd: Status 404 returned error can't find the container with id df80cf12a44c52028f7421c4257465d55e5f83fe538c7b4f153e15748c190afd Sep 11 02:03:07.561417 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.561394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" Sep 11 02:03:07.583438 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.582924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:07.614402 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.614370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2nb5" event={"ID":"afa90ece-d170-496d-ad54-fea89a85c403","Type":"ContainerStarted","Data":"df80cf12a44c52028f7421c4257465d55e5f83fe538c7b4f153e15748c190afd"} Sep 11 02:03:07.615869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.615837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtjkg" event={"ID":"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51","Type":"ContainerStarted","Data":"4ba6f257d05d0c4d6c8dd8254ae077fee0e6e9a6d092234d3a46ca4d1635f05e"} Sep 11 02:03:07.619118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.617960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:03:07.619118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.618132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8vrxg" event={"ID":"db0071c5-7ec4-407d-860c-2272d7a8e461","Type":"ContainerStarted","Data":"4fb2c9b55ad3560b0e4968c2f167c39b8cdee64d6f2005ff213a9b47d53fe846"} Sep 11 02:03:07.624693 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.624673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:03:07.710612 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.710582 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-csxtn\"" Sep 11 02:03:07.719179 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.719159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xspsb" Sep 11 02:03:07.734929 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.734908 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.734936 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.734962 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735009 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzrpk\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735198 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735178 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735277 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735243 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:03:07.735277 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735264 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735393 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735299 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735393 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735324 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") pod \"7e494738-1afc-437c-a77b-8426d805d0e4\" (UID: \"7e494738-1afc-437c-a77b-8426d805d0e4\") " Sep 11 02:03:07.735582 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735495 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:03:07.735582 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735520 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e494738-1afc-437c-a77b-8426d805d0e4-ca-trust-extracted\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.735977 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.735812 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:03:07.737704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.737657 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk" (OuterVolumeSpecName: "kube-api-access-gzrpk") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "kube-api-access-gzrpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:03:07.737704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.737670 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:03:07.737704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.737690 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:03:07.737874 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.737745 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:03:07.737874 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.737762 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7e494738-1afc-437c-a77b-8426d805d0e4" (UID: "7e494738-1afc-437c-a77b-8426d805d0e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:03:07.805077 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.805045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m"] Sep 11 02:03:07.807817 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.807790 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6840c87a_9441_436b_9588_ccd44ff16672.slice/crio-b6dfedc228c7173e8bbbd980457a9a05bcf1a82922822cafb8f85f3fe2c12931 WatchSource:0}: Error finding container b6dfedc228c7173e8bbbd980457a9a05bcf1a82922822cafb8f85f3fe2c12931: Status 404 returned error can't find the container with id b6dfedc228c7173e8bbbd980457a9a05bcf1a82922822cafb8f85f3fe2c12931 Sep 11 02:03:07.835246 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.835215 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst"] Sep 11 02:03:07.836349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836323 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-image-registry-private-configuration\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836344 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-registry-certificates\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836529 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836360 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-registry-tls\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836529 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836373 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-bound-sa-token\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836529 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836383 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e494738-1afc-437c-a77b-8426d805d0e4-trusted-ca\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836529 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836394 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzrpk\" (UniqueName: \"kubernetes.io/projected/7e494738-1afc-437c-a77b-8426d805d0e4-kube-api-access-gzrpk\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.836529 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.836406 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e494738-1afc-437c-a77b-8426d805d0e4-installation-pull-secrets\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:03:07.839537 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.839515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1348c7f2_e614_4ac9_995b_7fa737a78e77.slice/crio-a68c2a2511dd99f2ccbd4969475f0d466432a4de51710df2fec0988a3a47ea2a WatchSource:0}: Error finding container a68c2a2511dd99f2ccbd4969475f0d466432a4de51710df2fec0988a3a47ea2a: Status 404 returned error can't find the container with id a68c2a2511dd99f2ccbd4969475f0d466432a4de51710df2fec0988a3a47ea2a Sep 11 02:03:07.985354 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:07.985318 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xspsb"] Sep 11 02:03:07.990035 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:07.989681 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331f2a9b_8830_48f9_80da_400d95541e68.slice/crio-4b2431f5bc12bd35bed33d7551a611e9f6df1a5288abe6099f4038924a6ba8bd WatchSource:0}: Error finding container 4b2431f5bc12bd35bed33d7551a611e9f6df1a5288abe6099f4038924a6ba8bd: Status 404 returned error can't find the container with id 4b2431f5bc12bd35bed33d7551a611e9f6df1a5288abe6099f4038924a6ba8bd Sep 11 02:03:08.192406 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.192319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:08.251555 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.251514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:08.590833 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.590679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:08.626535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.626500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtjkg" event={"ID":"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51","Type":"ContainerStarted","Data":"cf5761ecf77e40471e8990f1e3c83fdb1b4fe175d5bae8f758e9ce254e5efc40"} Sep 11 02:03:08.628384 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.628307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xspsb" event={"ID":"331f2a9b-8830-48f9-80da-400d95541e68","Type":"ContainerStarted","Data":"4b2431f5bc12bd35bed33d7551a611e9f6df1a5288abe6099f4038924a6ba8bd"} Sep 11 02:03:08.632449 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.632393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" event={"ID":"1348c7f2-e614-4ac9-995b-7fa737a78e77","Type":"ContainerStarted","Data":"a68c2a2511dd99f2ccbd4969475f0d466432a4de51710df2fec0988a3a47ea2a"} Sep 11 02:03:08.636580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.635364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-586cf6fc66-t4lsp" Sep 11 02:03:08.636580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.636266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" event={"ID":"6840c87a-9441-436b-9588-ccd44ff16672","Type":"ContainerStarted","Data":"b6dfedc228c7173e8bbbd980457a9a05bcf1a82922822cafb8f85f3fe2c12931"} Sep 11 02:03:08.677510 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.677478 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-586cf6fc66-t4lsp"] Sep 11 02:03:08.678474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.678440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:08.682080 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.682055 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-586cf6fc66-t4lsp"] Sep 11 02:03:08.853201 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:08.853144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:09.006619 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.006487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:09.219679 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.219473 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e494738-1afc-437c-a77b-8426d805d0e4" path="/var/lib/kubelet/pods/7e494738-1afc-437c-a77b-8426d805d0e4/volumes" Sep 11 02:03:09.651767 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.651007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtjkg" event={"ID":"95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51","Type":"ContainerStarted","Data":"88ab8b171445e70277a6f2a453c8079b6920259cff2be3cfc402e1b470f98913"} Sep 11 02:03:09.666366 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.666305 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mtjkg" podStartSLOduration=66.712459731 podStartE2EDuration="1m7.666282174s" totalImagesPullingTime="953.822443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:09.665382737 +0000 UTC m=+68.941673362" watchObservedRunningTime="2026-09-11 02:03:09.666282174 +0000 UTC m=+68.942572769" Sep 11 02:03:09.792425 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.792389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:09.870284 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.870136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:09.939691 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:09.939589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.041511 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.041451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.142094 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.142044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.242124 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.242034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.467434 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.467297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.569914 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.569847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.917500 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.917401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:10.970324 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:10.970184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:11.319600 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:11.319493 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:11.400586 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:11.400546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:11.741912 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:11.741826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:11.842130 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:11.842094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:11.945000 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:11.944941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:12.380286 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:12.380242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:03:12.383082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:12.383050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/922b8481-0ae5-4736-a017-64809c5c02ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bv2c9\" (UID: \"922b8481-0ae5-4736-a017-64809c5c02ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:03:12.560734 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:12.560703 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zn2f7\"" Sep 11 02:03:12.568468 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:12.568440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" Sep 11 02:03:12.958823 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:12.958760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:13.010683 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:13.010651 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:13.071385 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:13.071351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:13.173507 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:13.173470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:14.031125 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:14.031078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:14.093459 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:14.093414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:15.298354 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:15.298316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:16.545903 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:16.545865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:16.602269 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:16.602229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:16.654395 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:16.654358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:17.501000 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.500890 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9"] Sep 11 02:03:17.683517 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.683426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2nb5" event={"ID":"afa90ece-d170-496d-ad54-fea89a85c403","Type":"ContainerStarted","Data":"0f235db130cd36dda781d8d6945262e3a188a9723b3db251782b101783a6aff0"} Sep 11 02:03:17.684017 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.683558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:03:17.685507 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.685478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xspsb" event={"ID":"331f2a9b-8830-48f9-80da-400d95541e68","Type":"ContainerStarted","Data":"04620ff2e44184f11e477a03513fe1f40b11a9b5542e4a699067e3d498c7bf2e"} Sep 11 02:03:17.685613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.685526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xspsb" event={"ID":"331f2a9b-8830-48f9-80da-400d95541e68","Type":"ContainerStarted","Data":"caefbed99578f62690daa754dc22c22b47939758fc546684529a8c259f467c82"} Sep 11 02:03:17.685613 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.685588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xspsb" Sep 11 02:03:17.687743 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.687721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" event={"ID":"1348c7f2-e614-4ac9-995b-7fa737a78e77","Type":"ContainerStarted","Data":"98f396f28f0e321c0cc563878d7cbf06456d88281b84dcbba1ac0f69a9243531"} Sep 11 02:03:17.687848 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.687750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" event={"ID":"1348c7f2-e614-4ac9-995b-7fa737a78e77","Type":"ContainerStarted","Data":"4d23973a9a975e9294b829690664838b3a7e448e7616446947a5e5e72af94958"} Sep 11 02:03:17.687848 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.687765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" event={"ID":"1348c7f2-e614-4ac9-995b-7fa737a78e77","Type":"ContainerStarted","Data":"57c9b32601ad580daecb05a30474bf388a5fd67dcade7f3b1ea3fa66c4a760f8"} Sep 11 02:03:17.689381 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.689359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" event={"ID":"6840c87a-9441-436b-9588-ccd44ff16672","Type":"ContainerStarted","Data":"9fd0240b8880ab90a543e391062bcd0a14d9d18f586226de17a6dc35335debbf"} Sep 11 02:03:17.689510 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.689495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:17.690736 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.690701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" event={"ID":"922b8481-0ae5-4736-a017-64809c5c02ba","Type":"ContainerStarted","Data":"f4db8938791ae37da71dfaa57c441f289c6326f6258f09b83c5191f79786ac7b"} Sep 11 02:03:17.691461 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.691442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" Sep 11 02:03:17.692319 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.692300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8vrxg" event={"ID":"db0071c5-7ec4-407d-860c-2272d7a8e461","Type":"ContainerStarted","Data":"487fe8dd9d8b6d21bc01e19770ebc848474f8cba567aa4ba7fb6c7ea6674d1f3"} Sep 11 02:03:17.697189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.697150 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g2nb5" podStartSLOduration=67.041900585 podStartE2EDuration="1m16.697138006s" totalImagesPullingTime="9.655237421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:17.696584544 +0000 UTC m=+76.972875163" watchObservedRunningTime="2026-09-11 02:03:17.697138006 +0000 UTC m=+76.973428645" Sep 11 02:03:17.713791 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.713729 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd5c97f66-9rvst" podStartSLOduration=1.329058908 podStartE2EDuration="10.713710876s" totalImagesPullingTime="9.384651968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:17.712793555 +0000 UTC m=+76.989084147" watchObservedRunningTime="2026-09-11 02:03:17.713710876 +0000 UTC m=+76.990001522" Sep 11 02:03:17.725560 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.725509 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8vrxg" podStartSLOduration=66.030700454 podStartE2EDuration="1m15.725490361s" totalImagesPullingTime="9.694789907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:17.725312345 +0000 UTC m=+77.001602958" watchObservedRunningTime="2026-09-11 02:03:17.725490361 +0000 UTC m=+77.001780956" Sep 11 02:03:17.745016 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.744947 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xspsb" podStartSLOduration=33.530541306 podStartE2EDuration="42.744920389s" totalImagesPullingTime="9.214379083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:17.744036033 +0000 UTC m=+77.020326646" watchObservedRunningTime="2026-09-11 02:03:17.744920389 +0000 UTC m=+77.021210982" Sep 11 02:03:17.757884 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:17.757819 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-694c749f87-c7j5m" podStartSLOduration=1.3394805 podStartE2EDuration="10.757807439s" totalImagesPullingTime="9.418326939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:17.757270029 +0000 UTC m=+77.033560625" watchObservedRunningTime="2026-09-11 02:03:17.757807439 +0000 UTC m=+77.034098030" Sep 11 02:03:18.378622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:18.378582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:19.467921 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.467887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:19.524111 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.524074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:19.700542 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.700508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" event={"ID":"922b8481-0ae5-4736-a017-64809c5c02ba","Type":"ContainerStarted","Data":"d538b1a3714e0101e077e15b0004157e72f5738391dd606a42353d9b4bc0e6d0"} Sep 11 02:03:19.715438 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.715375 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bv2c9" podStartSLOduration=38.521724644 podStartE2EDuration="39.715354306s" totalImagesPullingTime="1.193629662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:19.714659688 +0000 UTC m=+78.990950282" watchObservedRunningTime="2026-09-11 02:03:19.715354306 +0000 UTC m=+78.991644898" Sep 11 02:03:19.797884 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.797780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:19.899222 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:19.899185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.197255 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.197222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.372768 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.372721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.440144 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.440112 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s"] Sep 11 02:03:20.443441 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.443424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.446297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.446277 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 11 02:03:20.446561 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.446545 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k8tlm\"" Sep 11 02:03:20.447184 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.447166 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 02:03:20.447333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.447289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 11 02:03:20.447333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.447314 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 11 02:03:20.447475 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.447397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 02:03:20.447818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.447802 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 02:03:20.452810 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.452792 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xcwnx"] Sep 11 02:03:20.455773 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.455759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.457719 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.457695 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s"] Sep 11 02:03:20.457805 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.457740 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 02:03:20.458294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.458048 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dn89n\"" Sep 11 02:03:20.458294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.458067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 02:03:20.458294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.458207 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 02:03:20.475622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.475598 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.544017 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.543968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.544224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-textfile\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-sys\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xskq\" (UniqueName: \"kubernetes.io/projected/d9751981-c399-4776-8a6c-9b754f900124-kube-api-access-6xskq\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-wtmp\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544410 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-metrics-client-ca\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544410 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.544410 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544410 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-root\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544410 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pkd\" (UniqueName: \"kubernetes.io/projected/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-api-access-x2pkd\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-tls\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.544580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.544548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a4082b6-cb69-4524-8a9b-6ddee59df774-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.640934 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.640895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.644828 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xskq\" (UniqueName: \"kubernetes.io/projected/d9751981-c399-4776-8a6c-9b754f900124-kube-api-access-6xskq\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.644936 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-wtmp\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.644936 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-metrics-client-ca\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.644936 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.644936 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-root\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pkd\" (UniqueName: \"kubernetes.io/projected/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-api-access-x2pkd\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.644976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-wtmp\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-root\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-tls\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:03:20.645158 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a4082b6-cb69-4524-8a9b-6ddee59df774-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:03:20.645214 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls podName:7a4082b6-cb69-4524-8a9b-6ddee59df774 nodeName:}" failed. No retries permitted until 2026-09-11 02:03:21.145197004 +0000 UTC m=+80.421487579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-4dt2s" (UID: "7a4082b6-cb69-4524-8a9b-6ddee59df774") : secret "kube-state-metrics-tls" not found Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-textfile\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-sys\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9751981-c399-4776-8a6c-9b754f900124-sys\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.645895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-textfile\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.645895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.646087 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.645939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a4082b6-cb69-4524-8a9b-6ddee59df774-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.646423 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.646398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9751981-c399-4776-8a6c-9b754f900124-metrics-client-ca\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.647730 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.647703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.647867 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.647850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-tls\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.648172 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.648153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9751981-c399-4776-8a6c-9b754f900124-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.656884 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.656852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pkd\" (UniqueName: \"kubernetes.io/projected/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-api-access-x2pkd\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:20.657391 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.657370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xskq\" (UniqueName: \"kubernetes.io/projected/d9751981-c399-4776-8a6c-9b754f900124-kube-api-access-6xskq\") pod \"node-exporter-xcwnx\" (UID: \"d9751981-c399-4776-8a6c-9b754f900124\") " pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.764427 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.764349 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcwnx" Sep 11 02:03:20.776531 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:20.776502 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9751981_c399_4776_8a6c_9b754f900124.slice/crio-459caad7aee80a43a6cab8ab3bcf7ec63b77f69d3b98ab6e4ca81b2c9ec591fa WatchSource:0}: Error finding container 459caad7aee80a43a6cab8ab3bcf7ec63b77f69d3b98ab6e4ca81b2c9ec591fa: Status 404 returned error can't find the container with id 459caad7aee80a43a6cab8ab3bcf7ec63b77f69d3b98ab6e4ca81b2c9ec591fa Sep 11 02:03:20.780176 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.780151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:20.887176 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:20.887147 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.015729 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.015640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.115631 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.115594 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.149706 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.149670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:21.152054 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.152036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a4082b6-cb69-4524-8a9b-6ddee59df774-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4dt2s\" (UID: \"7a4082b6-cb69-4524-8a9b-6ddee59df774\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:21.216170 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.216102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.315858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.315819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.352245 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.352219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" Sep 11 02:03:21.417405 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.416699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.508072 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.508039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.619747 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.619657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:21.634214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.634181 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s"] Sep 11 02:03:21.690823 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:03:21.690791 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4082b6_cb69_4524_8a9b_6ddee59df774.slice/crio-8384c786aa61cb23beb5b3dda113027da5c0a2a2a141ba47c749e29762b7be1c WatchSource:0}: Error finding container 8384c786aa61cb23beb5b3dda113027da5c0a2a2a141ba47c749e29762b7be1c: Status 404 returned error can't find the container with id 8384c786aa61cb23beb5b3dda113027da5c0a2a2a141ba47c749e29762b7be1c Sep 11 02:03:21.707910 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.707873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" event={"ID":"7a4082b6-cb69-4524-8a9b-6ddee59df774","Type":"ContainerStarted","Data":"8384c786aa61cb23beb5b3dda113027da5c0a2a2a141ba47c749e29762b7be1c"} Sep 11 02:03:21.709122 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:21.709097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcwnx" event={"ID":"d9751981-c399-4776-8a6c-9b754f900124","Type":"ContainerStarted","Data":"459caad7aee80a43a6cab8ab3bcf7ec63b77f69d3b98ab6e4ca81b2c9ec591fa"} Sep 11 02:03:22.715601 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:22.715567 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9751981-c399-4776-8a6c-9b754f900124" containerID="36c1c6f0115e4d18110261758d3c4d9b6bb6505de05f5bc74da5149a923ea17c" exitCode=0 Sep 11 02:03:22.716102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:22.715632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcwnx" event={"ID":"d9751981-c399-4776-8a6c-9b754f900124","Type":"ContainerDied","Data":"36c1c6f0115e4d18110261758d3c4d9b6bb6505de05f5bc74da5149a923ea17c"} Sep 11 02:03:23.353502 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.353471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:23.425152 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.425114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:23.721214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.721118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" event={"ID":"7a4082b6-cb69-4524-8a9b-6ddee59df774","Type":"ContainerStarted","Data":"1148cfd6eff11aefd1231ee035330b69b776c5114618b8346a09c2292a847f6a"} Sep 11 02:03:23.721214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.721179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" event={"ID":"7a4082b6-cb69-4524-8a9b-6ddee59df774","Type":"ContainerStarted","Data":"bed1f9c14e01335e5281671c9129157ad71572261704119b6ca1ed503f71375b"} Sep 11 02:03:23.721214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.721207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" event={"ID":"7a4082b6-cb69-4524-8a9b-6ddee59df774","Type":"ContainerStarted","Data":"ff7a09ca35a7d62ae12ed34f2ea78742ea359462d54522a2278f223b1daa6e1d"} Sep 11 02:03:23.723366 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.723343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcwnx" event={"ID":"d9751981-c399-4776-8a6c-9b754f900124","Type":"ContainerStarted","Data":"2d78105b4292c375c3523cfd3686654068f14fe5cf492203eb3506fe0f128214"} Sep 11 02:03:23.723480 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.723386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcwnx" event={"ID":"d9751981-c399-4776-8a6c-9b754f900124","Type":"ContainerStarted","Data":"a79cb195a2b8552be59c14b99c10b834b56f4f630cb0b31d494346c9f882ed34"} Sep 11 02:03:23.738572 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.738515 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4dt2s" podStartSLOduration=2.5015651500000002 podStartE2EDuration="3.738495313s" totalImagesPullingTime="1.236930163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:23.737173898 +0000 UTC m=+83.013464516" watchObservedRunningTime="2026-09-11 02:03:23.738495313 +0000 UTC m=+83.014785906" Sep 11 02:03:23.754147 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.754086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xcwnx" podStartSLOduration=2.733704579 podStartE2EDuration="3.754063582s" totalImagesPullingTime="958.771054ms" totalInitContainerRuntime="61.587949ms" isStatefulPod=true podCreationTimestamp="2026-09-11 02:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:03:23.753305763 +0000 UTC m=+83.029596375" watchObservedRunningTime="2026-09-11 02:03:23.754063582 +0000 UTC m=+83.030354177" Sep 11 02:03:23.794806 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:23.794769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:24.088332 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:24.088292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:25.187923 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:25.187889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:25.287146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:25.287113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:25.631695 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:25.631658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:26.357951 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:26.357918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:26.458315 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:26.458278 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:26.592361 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:26.592323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:27.054535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:27.054505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:27.155437 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:27.155393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:27.698402 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:27.698368 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xspsb" Sep 11 02:03:27.798205 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:27.798167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:27.899308 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:27.899273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:28.072251 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:28.072216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:28.132145 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:28.132107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:29.508757 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:29.508728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:29.573049 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:29.573018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:30.969104 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:30.969053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:31.899588 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:31.899552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:31.971587 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:31.971549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:33.158242 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:33.158205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:35.119785 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:35.119747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:35.219257 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:35.219222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:35.322869 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:35.322831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:37.485970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:37.485941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:37.585695 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:37.585656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:41.016240 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:41.016203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:41.116972 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:41.116931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:42.575554 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:42.575502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:42.625313 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:42.625279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:43.072577 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:43.072534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:43.169679 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:43.169649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:47.364856 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:47.364815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:47.423284 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:47.423248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:47.973768 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:47.973727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:48.023362 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:48.023335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:48.699581 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:48.699543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g2nb5" Sep 11 02:03:58.072182 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:58.072146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:03:58.130483 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:03:58.130432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:21.947177 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:21.947128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:22.009771 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:22.009742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:36.490528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:36.490492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:36.542276 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:36.542243 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:48.266513 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:48.266475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:48.316109 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:48.316065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:58.087137 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:58.087050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:04:58.185861 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:04:58.185832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:10.115093 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:10.115050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:10.215672 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:10.215636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:10.317853 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:10.317802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:11.057520 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:11.057484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:11.110289 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:11.110244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:20.550284 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:20.550240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:20.613855 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:20.613823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:34.278300 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:34.278266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:34.326067 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:34.326037 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:39.557436 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:39.557361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:40.090495 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:40.090461 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:42.602606 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:42.602566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:05:42.699815 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:05:42.699779 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:05.057236 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:05.057197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:05.591306 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:05.591274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:09.237177 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:09.237148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:10.004711 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:10.004666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:12.825415 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:12.825382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:12.875306 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:12.875272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:14.315840 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:14.315801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:14.416170 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:14.416139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:15.096367 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:15.096335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:15.194054 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:15.194025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:16.133109 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.133071 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:16.326374 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.326335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:16.671110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.671072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:16.767458 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.767421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:16.915589 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.915560 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rqg59"] Sep 11 02:06:16.917504 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.917488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:16.919473 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.919455 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 11 02:06:16.919573 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.919532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 11 02:06:16.920274 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.920255 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5w54w\"" Sep 11 02:06:16.927803 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.927776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rqg59"] Sep 11 02:06:16.930972 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.930955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:16.931076 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:16.931004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w74wj\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-kube-api-access-w74wj\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.031554 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.031528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w74wj\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-kube-api-access-w74wj\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.031658 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.031571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.039395 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.039374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w74wj\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-kube-api-access-w74wj\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.039842 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.039826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/269660c0-58f1-4c75-bca9-6180c36ce60a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rqg59\" (UID: \"269660c0-58f1-4c75-bca9-6180c36ce60a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.226128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.226057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" Sep 11 02:06:17.492313 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:17.492290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rqg59"] Sep 11 02:06:17.494603 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:06:17.494574 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod269660c0_58f1_4c75_bca9_6180c36ce60a.slice/crio-6b0caf2f96fcf091035697c7d70b7b8cd9c09f70ddb848b80a4196be203e8cb5 WatchSource:0}: Error finding container 6b0caf2f96fcf091035697c7d70b7b8cd9c09f70ddb848b80a4196be203e8cb5: Status 404 returned error can't find the container with id 6b0caf2f96fcf091035697c7d70b7b8cd9c09f70ddb848b80a4196be203e8cb5 Sep 11 02:06:18.287674 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:18.287611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" event={"ID":"269660c0-58f1-4c75-bca9-6180c36ce60a","Type":"ContainerStarted","Data":"6b0caf2f96fcf091035697c7d70b7b8cd9c09f70ddb848b80a4196be203e8cb5"} Sep 11 02:06:19.826964 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:19.826909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:19.927541 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:19.927505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:21.276592 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:21.276561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:21.300551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:21.300519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" event={"ID":"269660c0-58f1-4c75-bca9-6180c36ce60a","Type":"ContainerStarted","Data":"ef4015a436485314be2145fdca2a4d30f1ef8f867a369c8b3e94a94ee9081f13"} Sep 11 02:06:21.315088 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:21.315040 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rqg59" podStartSLOduration=2.305907216 podStartE2EDuration="5.315024645s" totalImagesPullingTime="3.009117429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:06:21.313449339 +0000 UTC m=+260.589739932" watchObservedRunningTime="2026-09-11 02:06:21.315024645 +0000 UTC m=+260.591315237" Sep 11 02:06:21.377521 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:21.377481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:25.122854 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:25.122773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:27.707587 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:27.707553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:27.805771 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:27.805708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:33.442576 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:33.442540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:33.541681 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:33.541641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:35.123206 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:35.123172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:51.273642 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:51.273609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:52.211040 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.211009 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm"] Sep 11 02:06:52.212999 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.212970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.215723 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.215700 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 11 02:06:52.215827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.215699 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 11 02:06:52.216102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.216086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bl2dm\"" Sep 11 02:06:52.216162 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.216148 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 11 02:06:52.216426 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.216414 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 11 02:06:52.252188 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.252166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm"] Sep 11 02:06:52.273543 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.273514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwbdg\" (UniqueName: \"kubernetes.io/projected/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-kube-api-access-nwbdg\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.273647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.273550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-manifests\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.273700 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.273650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-tmp\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.273700 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.273685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.273971 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.273702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374467 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-tmp\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwbdg\" (UniqueName: \"kubernetes.io/projected/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-kube-api-access-nwbdg\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374647 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-manifests\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.374922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.374896 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-manifests\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.376703 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.376674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-tmp\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.376830 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.376811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.376969 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.376951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.383534 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.383515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwbdg\" (UniqueName: \"kubernetes.io/projected/8cb8bf05-aa7b-4df5-abcf-ef88ed67186b-kube-api-access-nwbdg\") pod \"opendatahub-operator-controller-manager-65646f9664-8xkpm\" (UID: \"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b\") " pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.523404 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.523321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:52.755366 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.755335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:52.795704 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.795643 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm"] Sep 11 02:06:52.798973 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:06:52.798948 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb8bf05_aa7b_4df5_abcf_ef88ed67186b.slice/crio-677a1a4373e562a30a688382ff77a5e2c630bf63ea0402de0bfbdffa85fc1019 WatchSource:0}: Error finding container 677a1a4373e562a30a688382ff77a5e2c630bf63ea0402de0bfbdffa85fc1019: Status 404 returned error can't find the container with id 677a1a4373e562a30a688382ff77a5e2c630bf63ea0402de0bfbdffa85fc1019 Sep 11 02:06:52.834775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.834744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:52.904974 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:52.904946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:53.003766 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:53.003721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:53.403751 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:53.403712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" event={"ID":"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b","Type":"ContainerStarted","Data":"677a1a4373e562a30a688382ff77a5e2c630bf63ea0402de0bfbdffa85fc1019"} Sep 11 02:06:55.446569 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:55.446530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:55.544547 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:55.544506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:06:56.416920 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:56.416848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" event={"ID":"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b","Type":"ContainerStarted","Data":"277c5a9d4a460a5c7398a2591c7e13167831aa7062037bbd654600ae74b18c89"} Sep 11 02:06:57.421496 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:57.421462 2581 generic.go:356] "Generic (PLEG): container finished" podID="8cb8bf05-aa7b-4df5-abcf-ef88ed67186b" containerID="277c5a9d4a460a5c7398a2591c7e13167831aa7062037bbd654600ae74b18c89" exitCode=0 Sep 11 02:06:57.421879 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:57.421570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" event={"ID":"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b","Type":"ContainerDied","Data":"277c5a9d4a460a5c7398a2591c7e13167831aa7062037bbd654600ae74b18c89"} Sep 11 02:06:58.428044 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:58.427981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" event={"ID":"8cb8bf05-aa7b-4df5-abcf-ef88ed67186b","Type":"ContainerStarted","Data":"0959712ab23dbc20d97b73ce720f723e7df810fc2d3e504bc79a4f40756b9fed"} Sep 11 02:06:58.428527 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:58.428133 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:06:58.453006 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:06:58.452920 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" podStartSLOduration=1.742810508 podStartE2EDuration="6.452900769s" totalImagesPullingTime="3.667937313s" totalInitContainerRuntime="1.042152948s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:06:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:06:58.451346972 +0000 UTC m=+297.727637586" watchObservedRunningTime="2026-09-11 02:06:58.452900769 +0000 UTC m=+297.729191362" Sep 11 02:07:01.133003 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:01.132959 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 02:07:04.273792 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:04.273751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:04.374332 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:04.374300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:09.433049 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:09.433024 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65646f9664-8xkpm" Sep 11 02:07:12.525849 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.525791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:12.645738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.645697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:12.890918 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.890881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:12.916640 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.916606 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-654b967dfc-br4n5"] Sep 11 02:07:12.919673 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.919653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:12.924383 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.924364 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 11 02:07:12.925368 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.925350 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 11 02:07:12.925485 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.925461 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 11 02:07:12.925608 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.925592 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 11 02:07:12.936634 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:12.936611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654b967dfc-br4n5"] Sep 11 02:07:13.028263 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.028234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce3fb496-cc44-46ac-b586-d62d25bf8647-tmp\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.028412 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.028273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce3fb496-cc44-46ac-b586-d62d25bf8647-tls-certs\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.028412 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.028299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrpv\" (UniqueName: \"kubernetes.io/projected/ce3fb496-cc44-46ac-b586-d62d25bf8647-kube-api-access-ddrpv\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.062079 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.062049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:13.129305 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.129274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce3fb496-cc44-46ac-b586-d62d25bf8647-tls-certs\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.129447 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.129309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrpv\" (UniqueName: \"kubernetes.io/projected/ce3fb496-cc44-46ac-b586-d62d25bf8647-kube-api-access-ddrpv\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.129447 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.129355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce3fb496-cc44-46ac-b586-d62d25bf8647-tmp\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.131596 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.131569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce3fb496-cc44-46ac-b586-d62d25bf8647-tmp\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.131767 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.131752 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce3fb496-cc44-46ac-b586-d62d25bf8647-tls-certs\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.136054 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.136020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrpv\" (UniqueName: \"kubernetes.io/projected/ce3fb496-cc44-46ac-b586-d62d25bf8647-kube-api-access-ddrpv\") pod \"kube-auth-proxy-654b967dfc-br4n5\" (UID: \"ce3fb496-cc44-46ac-b586-d62d25bf8647\") " pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.228758 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.228673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" Sep 11 02:07:13.519205 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.519132 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654b967dfc-br4n5"] Sep 11 02:07:13.522361 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:07:13.522327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3fb496_cc44_46ac_b586_d62d25bf8647.slice/crio-b2436465ed942e768e5755c60703538813290e9cc540762c59df1446bad38ede WatchSource:0}: Error finding container b2436465ed942e768e5755c60703538813290e9cc540762c59df1446bad38ede: Status 404 returned error can't find the container with id b2436465ed942e768e5755c60703538813290e9cc540762c59df1446bad38ede Sep 11 02:07:13.524041 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:13.524026 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:07:14.119847 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.119810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:14.150533 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.150509 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:14.154760 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.154741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.157369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.157342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 11 02:07:14.157471 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.157378 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 11 02:07:14.157671 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.157644 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 11 02:07:14.157849 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.157680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rqcgg\"" Sep 11 02:07:14.158109 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.158093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 11 02:07:14.172217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.172192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:14.210112 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.210077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:14.237240 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237397 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237397 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237397 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237573 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237573 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.237573 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.237477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnsl\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338469 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338649 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338649 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338649 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnsl\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338649 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338854 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.338854 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.338692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.339370 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.339340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.341648 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.341605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.342421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.342395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.342521 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.342468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.343666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.343642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.346412 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.346379 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnsl\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.346589 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.346566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hsnrd\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.466011 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.465915 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:14.489840 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.489803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" event={"ID":"ce3fb496-cc44-46ac-b586-d62d25bf8647","Type":"ContainerStarted","Data":"b2436465ed942e768e5755c60703538813290e9cc540762c59df1446bad38ede"} Sep 11 02:07:14.752487 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:14.752404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:14.757243 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:07:14.757211 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1945dc0f_9ca0_400b_9e5d_6aac92890847.slice/crio-c4f9f7d23d79d157933fa0b4ae055a2a9390aa43121661cfa283c05ebc555866 WatchSource:0}: Error finding container c4f9f7d23d79d157933fa0b4ae055a2a9390aa43121661cfa283c05ebc555866: Status 404 returned error can't find the container with id c4f9f7d23d79d157933fa0b4ae055a2a9390aa43121661cfa283c05ebc555866 Sep 11 02:07:15.040431 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:15.040350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:15.494778 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:15.494738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" event={"ID":"1945dc0f-9ca0-400b-9e5d-6aac92890847","Type":"ContainerStarted","Data":"c4f9f7d23d79d157933fa0b4ae055a2a9390aa43121661cfa283c05ebc555866"} Sep 11 02:07:16.502971 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:16.502930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" event={"ID":"ce3fb496-cc44-46ac-b586-d62d25bf8647","Type":"ContainerStarted","Data":"20797ad455fe8f23b794a9516c2eff3bcbc06754cbaddfda23f855a2edc3a282"} Sep 11 02:07:16.519442 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:16.519337 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-654b967dfc-br4n5" podStartSLOduration=1.6259458439999999 podStartE2EDuration="4.519315647s" totalImagesPullingTime="2.893369803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:07:16.519286576 +0000 UTC m=+315.795577187" watchObservedRunningTime="2026-09-11 02:07:16.519315647 +0000 UTC m=+315.795606240" Sep 11 02:07:18.167819 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:18.167781 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:07:18.168206 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:18.167859 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:07:18.511421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:18.511344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" event={"ID":"1945dc0f-9ca0-400b-9e5d-6aac92890847","Type":"ContainerStarted","Data":"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8"} Sep 11 02:07:18.511551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:18.511471 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:18.530185 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:18.530140 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" podStartSLOduration=1.122689981 podStartE2EDuration="4.53012486s" totalImagesPullingTime="3.407434879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:07:18.528322351 +0000 UTC m=+317.804612943" watchObservedRunningTime="2026-09-11 02:07:18.53012486 +0000 UTC m=+317.806415451" Sep 11 02:07:19.218149 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.218116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:19.316823 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.316773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:19.516676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.516602 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-hsnrd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 11 02:07:19.516676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.516659 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 11 02:07:19.801059 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.800969 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:19.970719 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:19.970683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:20.071804 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:20.071753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:22.515873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:22.515837 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:23.446333 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:23.446300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:23.544213 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:23.544180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:23.655587 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:23.655538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:23.805090 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:23.805010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:23.900191 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:23.900150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:24.053327 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:24.053289 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:33.094291 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.094247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:33.157270 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.157239 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf"] Sep 11 02:07:33.167602 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.167572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.168860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.168833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf"] Sep 11 02:07:33.173041 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.173022 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vtrjq\"" Sep 11 02:07:33.174697 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.174482 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 11 02:07:33.181675 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.181651 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l"] Sep 11 02:07:33.185193 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.184965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.190364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.190309 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 11 02:07:33.191034 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.190548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xnc2j\"" Sep 11 02:07:33.195157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.195133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:33.196267 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.196247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l"] Sep 11 02:07:33.285837 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.285804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.285837 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.285846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bjt\" (UniqueName: \"kubernetes.io/projected/c7046489-7e7c-4e21-8c95-b02837101ff9-kube-api-access-z8bjt\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.286078 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.285920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.286078 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.285956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmq89\" (UniqueName: \"kubernetes.io/projected/eb0ae041-de38-4ab6-922c-82f75a28fd49-kube-api-access-nmq89\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.386607 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.386516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.386607 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.386557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bjt\" (UniqueName: \"kubernetes.io/projected/c7046489-7e7c-4e21-8c95-b02837101ff9-kube-api-access-z8bjt\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.386607 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.386588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.386607 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.386610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq89\" (UniqueName: \"kubernetes.io/projected/eb0ae041-de38-4ab6-922c-82f75a28fd49-kube-api-access-nmq89\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.386955 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:07:33.386704 2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 11 02:07:33.386955 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:07:33.386745 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 11 02:07:33.386955 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:07:33.386778 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert podName:c7046489-7e7c-4e21-8c95-b02837101ff9 nodeName:}" failed. No retries permitted until 2026-09-11 02:07:33.886758065 +0000 UTC m=+333.163048639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert") pod "llmisvc-controller-manager-777c6bd7d5-gq95l" (UID: "c7046489-7e7c-4e21-8c95-b02837101ff9") : secret "llmisvc-webhook-server-cert" not found Sep 11 02:07:33.386955 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:07:33.386797 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert podName:eb0ae041-de38-4ab6-922c-82f75a28fd49 nodeName:}" failed. No retries permitted until 2026-09-11 02:07:33.886788377 +0000 UTC m=+333.163078952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert") pod "kserve-controller-manager-d6f4b65b8-zw4vf" (UID: "eb0ae041-de38-4ab6-922c-82f75a28fd49") : secret "kserve-webhook-server-cert" not found Sep 11 02:07:33.400589 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.400564 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bjt\" (UniqueName: \"kubernetes.io/projected/c7046489-7e7c-4e21-8c95-b02837101ff9-kube-api-access-z8bjt\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.401286 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.401258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq89\" (UniqueName: \"kubernetes.io/projected/eb0ae041-de38-4ab6-922c-82f75a28fd49-kube-api-access-nmq89\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.872295 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.872244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:33.891266 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.891230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.891415 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.891293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.893659 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.893638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7046489-7e7c-4e21-8c95-b02837101ff9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gq95l\" (UID: \"c7046489-7e7c-4e21-8c95-b02837101ff9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:33.893782 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.893704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0ae041-de38-4ab6-922c-82f75a28fd49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4vf\" (UID: \"eb0ae041-de38-4ab6-922c-82f75a28fd49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:33.942402 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:33.942369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:34.078123 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.078090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:34.102467 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.102437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:34.364177 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.364148 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf"] Sep 11 02:07:34.367117 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:07:34.367086 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0ae041_de38_4ab6_922c_82f75a28fd49.slice/crio-0765d03ac53fda459d8229062d709c953397b7cd5deba2322cbb06088cdd9fc0 WatchSource:0}: Error finding container 0765d03ac53fda459d8229062d709c953397b7cd5deba2322cbb06088cdd9fc0: Status 404 returned error can't find the container with id 0765d03ac53fda459d8229062d709c953397b7cd5deba2322cbb06088cdd9fc0 Sep 11 02:07:34.374852 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.374826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:34.390685 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.390549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l"] Sep 11 02:07:34.397068 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:07:34.397027 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc7046489_7e7c_4e21_8c95_b02837101ff9.slice/crio-c2ce3ee5642dd71f0a9158ee25ab11fd0dcc4af6fd5326e1503a3f638ad01f13 WatchSource:0}: Error finding container c2ce3ee5642dd71f0a9158ee25ab11fd0dcc4af6fd5326e1503a3f638ad01f13: Status 404 returned error can't find the container with id c2ce3ee5642dd71f0a9158ee25ab11fd0dcc4af6fd5326e1503a3f638ad01f13 Sep 11 02:07:34.461136 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.461103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:34.568189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.568155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" event={"ID":"c7046489-7e7c-4e21-8c95-b02837101ff9","Type":"ContainerStarted","Data":"c2ce3ee5642dd71f0a9158ee25ab11fd0dcc4af6fd5326e1503a3f638ad01f13"} Sep 11 02:07:34.569070 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.569039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:34.569415 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:34.569396 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" event={"ID":"eb0ae041-de38-4ab6-922c-82f75a28fd49","Type":"ContainerStarted","Data":"0765d03ac53fda459d8229062d709c953397b7cd5deba2322cbb06088cdd9fc0"} Sep 11 02:07:35.265214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.265166 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:35.265679 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.265398 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerName="discovery" containerID="cri-o://50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8" gracePeriod=30 Sep 11 02:07:35.571498 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.571471 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:35.574750 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.574719 2581 generic.go:356] "Generic (PLEG): container finished" podID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerID="50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8" exitCode=0 Sep 11 02:07:35.574866 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.574772 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" Sep 11 02:07:35.574866 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.574797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" event={"ID":"1945dc0f-9ca0-400b-9e5d-6aac92890847","Type":"ContainerDied","Data":"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8"} Sep 11 02:07:35.574866 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.574855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd" event={"ID":"1945dc0f-9ca0-400b-9e5d-6aac92890847","Type":"ContainerDied","Data":"c4f9f7d23d79d157933fa0b4ae055a2a9390aa43121661cfa283c05ebc555866"} Sep 11 02:07:35.574973 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.574884 2581 scope.go:117] "RemoveContainer" containerID="50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8" Sep 11 02:07:35.659486 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.659457 2581 scope.go:117] "RemoveContainer" containerID="50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8" Sep 11 02:07:35.659913 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:07:35.659879 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8\": container with ID starting with 50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8 not found: ID does not exist" containerID="50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8" Sep 11 02:07:35.660058 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.659925 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8"} err="failed to get container status \"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8\": rpc error: code = NotFound desc = could not find container \"50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8\": container with ID starting with 50b36e622ac29d79076e6ca5fbc2e9aa491cb55972509926b3938f021937fcb8 not found: ID does not exist" Sep 11 02:07:35.707184 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707154 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.707369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707219 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.707369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707243 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.707369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707264 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.707369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707297 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.708381 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707736 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxnsl\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.708381 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.707793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap\") pod \"1945dc0f-9ca0-400b-9e5d-6aac92890847\" (UID: \"1945dc0f-9ca0-400b-9e5d-6aac92890847\") " Sep 11 02:07:35.708793 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.708744 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:07:35.709973 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.709888 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token" (OuterVolumeSpecName: "istio-token") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:07:35.709973 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.709914 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts" (OuterVolumeSpecName: "cacerts") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:07:35.709973 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.709974 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs" (OuterVolumeSpecName: "local-certs") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:07:35.710226 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.710031 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:07:35.710378 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.710353 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:07:35.710559 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.710543 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl" (OuterVolumeSpecName: "kube-api-access-cxnsl") pod "1945dc0f-9ca0-400b-9e5d-6aac92890847" (UID: "1945dc0f-9ca0-400b-9e5d-6aac92890847"). InnerVolumeSpecName "kube-api-access-cxnsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:07:35.809653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809574 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-dns-cert\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809616 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1945dc0f-9ca0-400b-9e5d-6aac92890847-local-certs\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809633 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-cacerts\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809653 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809645 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-kubeconfig\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809945 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809659 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxnsl\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-kube-api-access-cxnsl\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809945 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809672 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-csr-ca-configmap\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.809945 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.809684 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1945dc0f-9ca0-400b-9e5d-6aac92890847-istio-token\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:07:35.895612 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.895584 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:35.899021 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:35.898978 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hsnrd"] Sep 11 02:07:37.217728 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:37.217693 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" path="/var/lib/kubelet/pods/1945dc0f-9ca0-400b-9e5d-6aac92890847/volumes" Sep 11 02:07:37.586427 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:37.586384 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" event={"ID":"eb0ae041-de38-4ab6-922c-82f75a28fd49","Type":"ContainerStarted","Data":"45a0fce23061fb64d86710a8583664e1699c26c03b4d78ad8a652c81fa8e99e0"} Sep 11 02:07:37.586770 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:37.586747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:07:37.602703 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:37.602647 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" podStartSLOduration=2.291964562 podStartE2EDuration="4.602634809s" totalImagesPullingTime="2.310670247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:07:37.601128971 +0000 UTC m=+336.877419590" watchObservedRunningTime="2026-09-11 02:07:37.602634809 +0000 UTC m=+336.878925416" Sep 11 02:07:38.591935 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:38.591895 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" event={"ID":"c7046489-7e7c-4e21-8c95-b02837101ff9","Type":"ContainerStarted","Data":"be9715e955bc942621fdb37a326d47f0619cf0b7e2914cb813709aaae1497a22"} Sep 11 02:07:38.611217 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:38.611170 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" podStartSLOduration=1.995382695 podStartE2EDuration="5.611156454s" totalImagesPullingTime="3.615773759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:07:38.610108142 +0000 UTC m=+337.886398755" watchObservedRunningTime="2026-09-11 02:07:38.611156454 +0000 UTC m=+337.887447045" Sep 11 02:07:39.595886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:39.595855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:07:42.438835 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:42.438800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:58.279492 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:58.279415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:07:58.332622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:07:58.332589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:08.597004 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:08.596960 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4vf" Sep 11 02:08:10.601242 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:10.601199 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gq95l" Sep 11 02:08:24.582803 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:24.582738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:24.641061 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:24.641023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:26.497272 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.497235 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f689878-bgsb6"] Sep 11 02:08:26.497636 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.497501 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerName="discovery" Sep 11 02:08:26.497636 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.497512 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerName="discovery" Sep 11 02:08:26.497636 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.497564 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1945dc0f-9ca0-400b-9e5d-6aac92890847" containerName="discovery" Sep 11 02:08:26.499316 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.499299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.501449 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.501424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w8xsw\"" Sep 11 02:08:26.501449 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.501429 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 02:08:26.502201 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502175 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 02:08:26.502201 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502202 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 11 02:08:26.502370 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502271 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 11 02:08:26.502370 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 11 02:08:26.502470 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 11 02:08:26.502585 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.502571 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 11 02:08:26.506250 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.505852 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 11 02:08:26.511719 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.511675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f689878-bgsb6"] Sep 11 02:08:26.546758 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.546722 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:26.570729 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-console-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570729 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-service-ca\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-oauth-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-oauth-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-trusted-ca-bundle\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgwkm\" (UniqueName: \"kubernetes.io/projected/7133fa08-ec04-4296-abf9-ceb962ccda58-kube-api-access-vgwkm\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.570922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.570902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671673 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-oauth-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671673 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-oauth-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-trusted-ca-bundle\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgwkm\" (UniqueName: \"kubernetes.io/projected/7133fa08-ec04-4296-abf9-ceb962ccda58-kube-api-access-vgwkm\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-console-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.671901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.671786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-service-ca\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.672533 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.672502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-oauth-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.672666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.672533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-console-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.672666 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.672589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-service-ca\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.672772 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.672684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7133fa08-ec04-4296-abf9-ceb962ccda58-trusted-ca-bundle\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.674233 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.674202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-oauth-config\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.674351 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.674328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7133fa08-ec04-4296-abf9-ceb962ccda58-console-serving-cert\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.679556 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.679532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgwkm\" (UniqueName: \"kubernetes.io/projected/7133fa08-ec04-4296-abf9-ceb962ccda58-kube-api-access-vgwkm\") pod \"console-79f689878-bgsb6\" (UID: \"7133fa08-ec04-4296-abf9-ceb962ccda58\") " pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:26.808625 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:26.808534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:27.080848 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:27.080822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f689878-bgsb6"] Sep 11 02:08:27.083279 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:27.083240 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7133fa08_ec04_4296_abf9_ceb962ccda58.slice/crio-8a14ac3a199b721d85a96efddef3ef4c44af887e5d2ed7022abf55c141d70d0d WatchSource:0}: Error finding container 8a14ac3a199b721d85a96efddef3ef4c44af887e5d2ed7022abf55c141d70d0d: Status 404 returned error can't find the container with id 8a14ac3a199b721d85a96efddef3ef4c44af887e5d2ed7022abf55c141d70d0d Sep 11 02:08:27.764551 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:27.764513 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f689878-bgsb6" event={"ID":"7133fa08-ec04-4296-abf9-ceb962ccda58","Type":"ContainerStarted","Data":"8a14ac3a199b721d85a96efddef3ef4c44af887e5d2ed7022abf55c141d70d0d"} Sep 11 02:08:30.777534 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:30.777499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f689878-bgsb6" event={"ID":"7133fa08-ec04-4296-abf9-ceb962ccda58","Type":"ContainerStarted","Data":"9cafa93c9805cb5c4b38c98a6d6f6ef8a720fab0c9453b971daa24674509057c"} Sep 11 02:08:30.796541 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:30.796490 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79f689878-bgsb6" podStartSLOduration=2.035483001 podStartE2EDuration="4.796475379s" totalImagesPullingTime="2.760992378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:30.795283282 +0000 UTC m=+390.071573900" watchObservedRunningTime="2026-09-11 02:08:30.796475379 +0000 UTC m=+390.072766026" Sep 11 02:08:32.991296 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:32.991254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:33.092235 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:33.092206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:36.809654 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:36.809617 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:36.810171 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:36.809707 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:36.815677 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:36.815649 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:37.762622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:37.762584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:37.806453 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:37.806425 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f689878-bgsb6" Sep 11 02:08:37.961207 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:37.961168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:38.069706 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:38.069673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:38.571687 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:38.571660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:39.358455 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:39.358421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:41.647362 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:41.647327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:41.770405 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:41.770368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:42.296532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.296498 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk"] Sep 11 02:08:42.298931 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.298916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.302552 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.302532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 11 02:08:42.302889 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.302874 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t8x6g\"" Sep 11 02:08:42.303189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.303168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 11 02:08:42.312230 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.312208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk"] Sep 11 02:08:42.392828 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.392799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvt6\" (UniqueName: \"kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.392999 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.392905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.493297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.493263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.493462 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.493316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvt6\" (UniqueName: \"kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.493689 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.493667 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.504002 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.503949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvt6\" (UniqueName: \"kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.608503 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.608466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:42.879665 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.879635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk"] Sep 11 02:08:42.882667 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:42.882634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d80e0c_2480_4414_979d_f335069b4626.slice/crio-aa17535c5fb8670e273b6b183064794ea3c56fc29abf28daeabd881cfc3fd39b WatchSource:0}: Error finding container aa17535c5fb8670e273b6b183064794ea3c56fc29abf28daeabd881cfc3fd39b: Status 404 returned error can't find the container with id aa17535c5fb8670e273b6b183064794ea3c56fc29abf28daeabd881cfc3fd39b Sep 11 02:08:42.975620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:42.975583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:43.828456 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:43.828425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" event={"ID":"88d80e0c-2480-4414-979d-f335069b4626","Type":"ContainerStarted","Data":"aa17535c5fb8670e273b6b183064794ea3c56fc29abf28daeabd881cfc3fd39b"} Sep 11 02:08:43.993303 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:43.993214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:44.283227 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.283092 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m"] Sep 11 02:08:44.286220 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.286195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:44.291457 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.291252 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 11 02:08:44.291800 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.291737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fhm45\"" Sep 11 02:08:44.306420 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.306344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m"] Sep 11 02:08:44.408114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.408076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdtvd\" (UniqueName: \"kubernetes.io/projected/97c6f31a-ba3f-4402-bd3a-7685af135eba-kube-api-access-hdtvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-49h4m\" (UID: \"97c6f31a-ba3f-4402-bd3a-7685af135eba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:44.509572 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.509523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdtvd\" (UniqueName: \"kubernetes.io/projected/97c6f31a-ba3f-4402-bd3a-7685af135eba-kube-api-access-hdtvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-49h4m\" (UID: \"97c6f31a-ba3f-4402-bd3a-7685af135eba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:44.519691 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.519662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdtvd\" (UniqueName: \"kubernetes.io/projected/97c6f31a-ba3f-4402-bd3a-7685af135eba-kube-api-access-hdtvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-49h4m\" (UID: \"97c6f31a-ba3f-4402-bd3a-7685af135eba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:44.608095 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.608058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:44.821481 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:44.821417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:45.163012 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:45.162954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:45.637450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:45.637407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m"] Sep 11 02:08:45.642436 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:45.642407 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c6f31a_ba3f_4402_bd3a_7685af135eba.slice/crio-d6434e8749b3a408a5cce2622631c5184370ab7aba07977980bae9029f38f26c WatchSource:0}: Error finding container d6434e8749b3a408a5cce2622631c5184370ab7aba07977980bae9029f38f26c: Status 404 returned error can't find the container with id d6434e8749b3a408a5cce2622631c5184370ab7aba07977980bae9029f38f26c Sep 11 02:08:45.838677 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:45.838630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" event={"ID":"97c6f31a-ba3f-4402-bd3a-7685af135eba","Type":"ContainerStarted","Data":"d6434e8749b3a408a5cce2622631c5184370ab7aba07977980bae9029f38f26c"} Sep 11 02:08:47.002577 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.002539 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7gv58"] Sep 11 02:08:47.005158 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.005138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:47.007416 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.007390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zc8bq\"" Sep 11 02:08:47.016187 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.016158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7gv58"] Sep 11 02:08:47.016925 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.016878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:47.134584 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.134544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrzs\" (UniqueName: \"kubernetes.io/projected/8f8177cf-83e4-4a12-9947-11b2e04d424e-kube-api-access-tnrzs\") pod \"authorino-operator-76b478bd78-7gv58\" (UID: \"8f8177cf-83e4-4a12-9947-11b2e04d424e\") " pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:47.235520 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.235474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrzs\" (UniqueName: \"kubernetes.io/projected/8f8177cf-83e4-4a12-9947-11b2e04d424e-kube-api-access-tnrzs\") pod \"authorino-operator-76b478bd78-7gv58\" (UID: \"8f8177cf-83e4-4a12-9947-11b2e04d424e\") " pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:47.243544 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.243504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrzs\" (UniqueName: \"kubernetes.io/projected/8f8177cf-83e4-4a12-9947-11b2e04d424e-kube-api-access-tnrzs\") pod \"authorino-operator-76b478bd78-7gv58\" (UID: \"8f8177cf-83e4-4a12-9947-11b2e04d424e\") " pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:47.318846 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.318807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:47.759493 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:47.759357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:48.110497 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.110448 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7gv58"] Sep 11 02:08:48.113756 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:48.113721 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8177cf_83e4_4a12_9947_11b2e04d424e.slice/crio-4c00435f5e5c899907effc81d4a57c8b5c91eca83b07cc0f9b09c3b0510423f2 WatchSource:0}: Error finding container 4c00435f5e5c899907effc81d4a57c8b5c91eca83b07cc0f9b09c3b0510423f2: Status 404 returned error can't find the container with id 4c00435f5e5c899907effc81d4a57c8b5c91eca83b07cc0f9b09c3b0510423f2 Sep 11 02:08:48.789007 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.788942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:48.854760 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.854726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" event={"ID":"8f8177cf-83e4-4a12-9947-11b2e04d424e","Type":"ContainerStarted","Data":"4c00435f5e5c899907effc81d4a57c8b5c91eca83b07cc0f9b09c3b0510423f2"} Sep 11 02:08:48.856429 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.856402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" event={"ID":"88d80e0c-2480-4414-979d-f335069b4626","Type":"ContainerStarted","Data":"e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d"} Sep 11 02:08:48.856590 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.856518 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:08:48.876874 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:48.876826 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" podStartSLOduration=1.880632035 podStartE2EDuration="6.87681082s" totalImagesPullingTime="4.996178785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:48.87510476 +0000 UTC m=+408.151395353" watchObservedRunningTime="2026-09-11 02:08:48.87681082 +0000 UTC m=+408.153101411" Sep 11 02:08:49.193339 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.193299 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb"] Sep 11 02:08:49.195610 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.195579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:49.197827 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.197806 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wppzs\"" Sep 11 02:08:49.222610 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.222538 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb"] Sep 11 02:08:49.351763 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.351728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9gv4\" (UniqueName: \"kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4\") pod \"limitador-operator-controller-manager-74495c69f8-mljvb\" (UID: \"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:49.453271 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.453169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9gv4\" (UniqueName: \"kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4\") pod \"limitador-operator-controller-manager-74495c69f8-mljvb\" (UID: \"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:49.462631 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.462601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9gv4\" (UniqueName: \"kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4\") pod \"limitador-operator-controller-manager-74495c69f8-mljvb\" (UID: \"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:49.507684 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.507492 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:49.789981 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.789901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb"] Sep 11 02:08:49.792668 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:49.792643 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea4ffbe_dce3_4e6e_97e5_f2fca3cde9b0.slice/crio-934a9d6bf542d3aa9763dccc499585508f5d308aaa4022d20ace12b5951de820 WatchSource:0}: Error finding container 934a9d6bf542d3aa9763dccc499585508f5d308aaa4022d20ace12b5951de820: Status 404 returned error can't find the container with id 934a9d6bf542d3aa9763dccc499585508f5d308aaa4022d20ace12b5951de820 Sep 11 02:08:49.862092 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.862060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" event={"ID":"8f8177cf-83e4-4a12-9947-11b2e04d424e","Type":"ContainerStarted","Data":"7f7379d5cf2b4401b01d728dd39243de4be108c18464ffd92422aee83043547f"} Sep 11 02:08:49.862268 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.862123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:08:49.863421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.863392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" event={"ID":"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0","Type":"ContainerStarted","Data":"934a9d6bf542d3aa9763dccc499585508f5d308aaa4022d20ace12b5951de820"} Sep 11 02:08:49.864845 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.864822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" event={"ID":"97c6f31a-ba3f-4402-bd3a-7685af135eba","Type":"ContainerStarted","Data":"449a4b939a3386f3ef6af7117cd35751cf45f968aaa7ba82254303cfbda4ba73"} Sep 11 02:08:49.864965 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.864949 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:08:49.888875 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.888828 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" podStartSLOduration=2.451441362 podStartE2EDuration="3.888812245s" totalImagesPullingTime="1.437370883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:49.888065179 +0000 UTC m=+409.164355799" watchObservedRunningTime="2026-09-11 02:08:49.888812245 +0000 UTC m=+409.165102833" Sep 11 02:08:49.906003 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:49.905940 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" podStartSLOduration=2.676703884 podStartE2EDuration="5.905926363s" totalImagesPullingTime="3.229222479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:49.904176338 +0000 UTC m=+409.180466948" watchObservedRunningTime="2026-09-11 02:08:49.905926363 +0000 UTC m=+409.182216954" Sep 11 02:08:50.864520 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.864481 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn"] Sep 11 02:08:50.865385 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.865344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:50.867160 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.867141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:50.869250 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.869224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 11 02:08:50.869536 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.869518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 11 02:08:50.869739 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.869721 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btzgm\"" Sep 11 02:08:50.880716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.879956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn"] Sep 11 02:08:50.965441 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.965403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:50.965624 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.965470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:50.965624 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.965500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89rf\" (UniqueName: \"kubernetes.io/projected/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-kube-api-access-f89rf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:50.983720 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:50.983682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:51.065972 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.065926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.066153 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.066026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.066153 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.066070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89rf\" (UniqueName: \"kubernetes.io/projected/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-kube-api-access-f89rf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.066735 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.066702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.068939 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.068890 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.074811 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.074757 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89rf\" (UniqueName: \"kubernetes.io/projected/f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b-kube-api-access-f89rf\") pod \"kuadrant-console-plugin-fbdd4f445-v77dn\" (UID: \"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.186491 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.186412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" Sep 11 02:08:51.471818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.471742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn"] Sep 11 02:08:51.475565 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:08:51.475540 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1bb2477_22c6_4f40_9f8e_cb8ffbb0f61b.slice/crio-3fa5706cf9361bb9effa6b12347d858e0913bbf44a4ac2f7dfc3d14da84141e7 WatchSource:0}: Error finding container 3fa5706cf9361bb9effa6b12347d858e0913bbf44a4ac2f7dfc3d14da84141e7: Status 404 returned error can't find the container with id 3fa5706cf9361bb9effa6b12347d858e0913bbf44a4ac2f7dfc3d14da84141e7 Sep 11 02:08:51.881524 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.881489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" event={"ID":"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0","Type":"ContainerStarted","Data":"d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597"} Sep 11 02:08:51.881937 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.881575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:08:51.882686 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.882663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" event={"ID":"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b","Type":"ContainerStarted","Data":"3fa5706cf9361bb9effa6b12347d858e0913bbf44a4ac2f7dfc3d14da84141e7"} Sep 11 02:08:51.898886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:51.898838 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" podStartSLOduration=1.4822102830000001 podStartE2EDuration="2.898816377s" totalImagesPullingTime="1.416606094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:51.897824484 +0000 UTC m=+411.174115090" watchObservedRunningTime="2026-09-11 02:08:51.898816377 +0000 UTC m=+411.175106982" Sep 11 02:08:52.756968 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:52.756931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:52.810340 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:52.810298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:53.148628 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:53.148589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:53.205382 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:53.205346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:53.555535 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:53.555441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:53.618889 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:53.618849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:56.907820 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:56.907781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" event={"ID":"f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b","Type":"ContainerStarted","Data":"36dc3ac773813f0241e719104cb39baab2c13b9ef242fb12f09e6a462a8e0fb3"} Sep 11 02:08:56.922454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:56.922402 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v77dn" podStartSLOduration=2.4926912359999998 podStartE2EDuration="6.922386304s" totalImagesPullingTime="4.429695068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:08:56.92093061 +0000 UTC m=+416.197221201" watchObservedRunningTime="2026-09-11 02:08:56.922386304 +0000 UTC m=+416.198676896" Sep 11 02:08:59.219073 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:59.219044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:59.274008 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:59.273951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:08:59.867186 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:08:59.867159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:00.877502 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:00.877468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-7gv58" Sep 11 02:09:00.877871 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:00.877551 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-49h4m" Sep 11 02:09:01.892283 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.892249 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d"] Sep 11 02:09:01.895107 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.895090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:01.914093 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.914058 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d"] Sep 11 02:09:01.950023 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.949973 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d"] Sep 11 02:09:01.950247 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:01.950228 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xtstf], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-xtstf]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" podUID="b266cc83-a21a-4d7f-be81-35e3e32b328b" Sep 11 02:09:01.960434 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.960395 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d"] Sep 11 02:09:01.975242 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.975208 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk"] Sep 11 02:09:01.975428 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.975406 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" podUID="88d80e0c-2480-4414-979d-f335069b4626" containerName="manager" containerID="cri-o://e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d" gracePeriod=2 Sep 11 02:09:02.000018 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:01.999958 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk"] Sep 11 02:09:02.025656 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.025606 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"88d80e0c-2480-4414-979d-f335069b4626\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\": pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.029126 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.029096 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl"] Sep 11 02:09:02.029507 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.029489 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d80e0c-2480-4414-979d-f335069b4626" containerName="manager" Sep 11 02:09:02.029507 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.029508 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d80e0c-2480-4414-979d-f335069b4626" containerName="manager" Sep 11 02:09:02.029643 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.029566 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d80e0c-2480-4414-979d-f335069b4626" containerName="manager" Sep 11 02:09:02.031581 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.031558 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb"] Sep 11 02:09:02.031701 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.031686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.031797 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.031763 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" containerName="manager" containerID="cri-o://d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597" gracePeriod=2 Sep 11 02:09:02.031944 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.031777 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:02.034115 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.034094 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.034232 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.034157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.053520 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.053493 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb"] Sep 11 02:09:02.068104 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.068061 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-mljvb\": pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.071038 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.070978 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.071709 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.071686 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:02.084176 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.084145 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.089348 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.089318 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl"] Sep 11 02:09:02.097101 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.097078 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj"] Sep 11 02:09:02.097436 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.097419 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" containerName="manager" Sep 11 02:09:02.097518 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.097439 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" containerName="manager" Sep 11 02:09:02.097518 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.097515 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" containerName="manager" Sep 11 02:09:02.099339 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.099321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.124134 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.124088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj"] Sep 11 02:09:02.156582 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.156555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mg6x\" (UniqueName: \"kubernetes.io/projected/ace1cf4b-f345-434b-a908-f59a8b248ec0-kube-api-access-2mg6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.156716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.156616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2cg8\" (UniqueName: \"kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.156716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.156654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.156716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.156699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace1cf4b-f345-434b-a908-f59a8b248ec0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.167504 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.167321 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.187090 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.187054 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.188788 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.188766 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.257082 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2cg8\" (UniqueName: \"kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.257211 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwgdj\" (UniqueName: \"kubernetes.io/projected/0d454f87-f9e8-4a0d-bd20-1320db62ef6c-kube-api-access-lwgdj\") pod \"limitador-operator-controller-manager-74495c69f8-tx6zj\" (UID: \"0d454f87-f9e8-4a0d-bd20-1320db62ef6c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.257211 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.257211 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace1cf4b-f345-434b-a908-f59a8b248ec0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.257211 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mg6x\" (UniqueName: \"kubernetes.io/projected/ace1cf4b-f345-434b-a908-f59a8b248ec0-kube-api-access-2mg6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.257614 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.257614 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.257535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace1cf4b-f345-434b-a908-f59a8b248ec0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.264846 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.264817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mg6x\" (UniqueName: \"kubernetes.io/projected/ace1cf4b-f345-434b-a908-f59a8b248ec0-kube-api-access-2mg6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-h5hhl\" (UID: \"ace1cf4b-f345-434b-a908-f59a8b248ec0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.265456 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.265429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2cg8\" (UniqueName: \"kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-55p6s\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.271081 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.271062 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.273076 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.273053 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.274660 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.274638 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.274750 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.274735 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.276306 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.276279 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.277733 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.277713 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.357849 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.357815 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume\") pod \"88d80e0c-2480-4414-979d-f335069b4626\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " Sep 11 02:09:02.358038 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.357864 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbvt6\" (UniqueName: \"kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6\") pod \"88d80e0c-2480-4414-979d-f335069b4626\" (UID: \"88d80e0c-2480-4414-979d-f335069b4626\") " Sep 11 02:09:02.358038 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.357884 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9gv4\" (UniqueName: \"kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4\") pod \"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\" (UID: \"9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0\") " Sep 11 02:09:02.358038 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.358017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwgdj\" (UniqueName: \"kubernetes.io/projected/0d454f87-f9e8-4a0d-bd20-1320db62ef6c-kube-api-access-lwgdj\") pod \"limitador-operator-controller-manager-74495c69f8-tx6zj\" (UID: \"0d454f87-f9e8-4a0d-bd20-1320db62ef6c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.358297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.358273 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88d80e0c-2480-4414-979d-f335069b4626" (UID: "88d80e0c-2480-4414-979d-f335069b4626"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:09:02.360190 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.360163 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4" (OuterVolumeSpecName: "kube-api-access-s9gv4") pod "9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" (UID: "9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0"). InnerVolumeSpecName "kube-api-access-s9gv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:09:02.360285 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.360190 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6" (OuterVolumeSpecName: "kube-api-access-zbvt6") pod "88d80e0c-2480-4414-979d-f335069b4626" (UID: "88d80e0c-2480-4414-979d-f335069b4626"). InnerVolumeSpecName "kube-api-access-zbvt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:09:02.365545 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.365521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwgdj\" (UniqueName: \"kubernetes.io/projected/0d454f87-f9e8-4a0d-bd20-1320db62ef6c-kube-api-access-lwgdj\") pod \"limitador-operator-controller-manager-74495c69f8-tx6zj\" (UID: \"0d454f87-f9e8-4a0d-bd20-1320db62ef6c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.396548 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.396516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.402460 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.402411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.410180 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.410157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.458620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.458557 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d80e0c-2480-4414-979d-f335069b4626-extensions-socket-volume\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:02.458620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.458580 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbvt6\" (UniqueName: \"kubernetes.io/projected/88d80e0c-2480-4414-979d-f335069b4626-kube-api-access-zbvt6\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:02.458620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.458589 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9gv4\" (UniqueName: \"kubernetes.io/projected/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0-kube-api-access-s9gv4\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:02.675226 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.675041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl"] Sep 11 02:09:02.678187 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:02.678156 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace1cf4b_f345_434b_a908_f59a8b248ec0.slice/crio-a6660617f94faa8f3828a354772e8d1d2eb533841cce67120a144aa1d204be37 WatchSource:0}: Error finding container a6660617f94faa8f3828a354772e8d1d2eb533841cce67120a144aa1d204be37: Status 404 returned error can't find the container with id a6660617f94faa8f3828a354772e8d1d2eb533841cce67120a144aa1d204be37 Sep 11 02:09:02.684636 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.684603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:02.686632 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:02.686612 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e277c81_5e57_4fef_a6fb_65b5d9d74748.slice/crio-94077a99c30a084c9f618bbb12e242f3ee72d540f5f77bdb89f805e419569759 WatchSource:0}: Error finding container 94077a99c30a084c9f618bbb12e242f3ee72d540f5f77bdb89f805e419569759: Status 404 returned error can't find the container with id 94077a99c30a084c9f618bbb12e242f3ee72d540f5f77bdb89f805e419569759 Sep 11 02:09:02.696931 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.696903 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj"] Sep 11 02:09:02.708094 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:02.708069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d454f87_f9e8_4a0d_bd20_1320db62ef6c.slice/crio-1aaa1e85dc4923e13ffba6f5efe528fa1031e1fc7dbfb525b357f0f6299938f5 WatchSource:0}: Error finding container 1aaa1e85dc4923e13ffba6f5efe528fa1031e1fc7dbfb525b357f0f6299938f5: Status 404 returned error can't find the container with id 1aaa1e85dc4923e13ffba6f5efe528fa1031e1fc7dbfb525b357f0f6299938f5 Sep 11 02:09:02.942377 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.942234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" event={"ID":"0d454f87-f9e8-4a0d-bd20-1320db62ef6c","Type":"ContainerStarted","Data":"969761a91c3e1cd76d4da98ba4c1d0cfd20d1527869107c89b2df9de67493323"} Sep 11 02:09:02.942979 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.942906 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" event={"ID":"0d454f87-f9e8-4a0d-bd20-1320db62ef6c","Type":"ContainerStarted","Data":"1aaa1e85dc4923e13ffba6f5efe528fa1031e1fc7dbfb525b357f0f6299938f5"} Sep 11 02:09:02.943089 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.943018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:02.947189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.947125 2581 generic.go:356] "Generic (PLEG): container finished" podID="88d80e0c-2480-4414-979d-f335069b4626" containerID="e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d" exitCode=0 Sep 11 02:09:02.947339 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.947324 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.947422 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.947334 2581 scope.go:117] "RemoveContainer" containerID="e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d" Sep 11 02:09:02.950036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.949930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" event={"ID":"8e277c81-5e57-4fef-a6fb-65b5d9d74748","Type":"ContainerStarted","Data":"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50"} Sep 11 02:09:02.950036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.950014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" event={"ID":"8e277c81-5e57-4fef-a6fb-65b5d9d74748","Type":"ContainerStarted","Data":"94077a99c30a084c9f618bbb12e242f3ee72d540f5f77bdb89f805e419569759"} Sep 11 02:09:02.950429 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.950078 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:02.954586 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.954561 2581 generic.go:356] "Generic (PLEG): container finished" podID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" containerID="d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597" exitCode=0 Sep 11 02:09:02.954680 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.954628 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.956903 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.956874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" event={"ID":"ace1cf4b-f345-434b-a908-f59a8b248ec0","Type":"ContainerStarted","Data":"5344025692ace93240e473318e807796d58cd2fc8ad27ddbad81b58e123dbe4a"} Sep 11 02:09:02.957032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.956949 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:02.957032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.956967 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:02.957032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.957024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" event={"ID":"ace1cf4b-f345-434b-a908-f59a8b248ec0","Type":"ContainerStarted","Data":"a6660617f94faa8f3828a354772e8d1d2eb533841cce67120a144aa1d204be37"} Sep 11 02:09:02.960097 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.959947 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:02.960097 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.959966 2581 scope.go:117] "RemoveContainer" containerID="e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d" Sep 11 02:09:02.960337 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.960293 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" podStartSLOduration=0.960277026 podStartE2EDuration="960.277026ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:02.958143933 +0000 UTC m=+422.234434547" watchObservedRunningTime="2026-09-11 02:09:02.960277026 +0000 UTC m=+422.236567619" Sep 11 02:09:02.960337 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.960333 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d\": container with ID starting with e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d not found: ID does not exist" containerID="e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d" Sep 11 02:09:02.960466 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.960362 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d"} err="failed to get container status \"e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d\": rpc error: code = NotFound desc = could not find container \"e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d\": container with ID starting with e6514eed9df680e8f3f38701751fbf97c2a2524a4381696b8d2670d77b538f2d not found: ID does not exist" Sep 11 02:09:02.960466 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.960386 2581 scope.go:117] "RemoveContainer" containerID="d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597" Sep 11 02:09:02.961767 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.961739 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:02.969638 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.969620 2581 scope.go:117] "RemoveContainer" containerID="d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597" Sep 11 02:09:02.969939 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:02.969918 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597\": container with ID starting with d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597 not found: ID does not exist" containerID="d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597" Sep 11 02:09:02.970036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.969951 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597"} err="failed to get container status \"d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597\": rpc error: code = NotFound desc = could not find container \"d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597\": container with ID starting with d821934947a7c84d6034b7c653ee14fc953ef9ac4505e91fad09f9ac97b99597 not found: ID does not exist" Sep 11 02:09:02.973218 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.973202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:02.981247 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:02.981210 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" podStartSLOduration=1.981197801 podStartE2EDuration="1.981197801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:02.980176588 +0000 UTC m=+422.256467197" watchObservedRunningTime="2026-09-11 02:09:02.981197801 +0000 UTC m=+422.257488393" Sep 11 02:09:03.010331 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:03.010273 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" podStartSLOduration=2.010251642 podStartE2EDuration="2.010251642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:03.00823856 +0000 UTC m=+422.284529166" watchObservedRunningTime="2026-09-11 02:09:03.010251642 +0000 UTC m=+422.286542235" Sep 11 02:09:03.010586 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.010355 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:03.012430 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.012394 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-2jw2d\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="b266cc83-a21a-4d7f-be81-35e3e32b328b" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:03.014574 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.014547 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:03.016307 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.016281 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-2jw2d\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="b266cc83-a21a-4d7f-be81-35e3e32b328b" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:03.017824 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.017795 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mljvb\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mljvb" Sep 11 02:09:03.020704 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.020675 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mdhbk\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="88d80e0c-2480-4414-979d-f335069b4626" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mdhbk" Sep 11 02:09:03.220556 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:03.220483 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d80e0c-2480-4414-979d-f335069b4626" path="/var/lib/kubelet/pods/88d80e0c-2480-4414-979d-f335069b4626/volumes" Sep 11 02:09:03.220807 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:03.220795 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0" path="/var/lib/kubelet/pods/9ea4ffbe-dce3-4e6e-97e5-f2fca3cde9b0/volumes" Sep 11 02:09:03.221085 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:03.221072 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b266cc83-a21a-4d7f-be81-35e3e32b328b" path="/var/lib/kubelet/pods/b266cc83-a21a-4d7f-be81-35e3e32b328b/volumes" Sep 11 02:09:03.963231 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:03.963200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:03.967264 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:03.967233 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-2jw2d\" is forbidden: User \"system:node:ip-10-0-135-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-234.ec2.internal' and this object" podUID="b266cc83-a21a-4d7f-be81-35e3e32b328b" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-2jw2d" Sep 11 02:09:05.775198 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:05.775163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:05.872779 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:05.872744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:08.770421 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:08.770383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:08.871084 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:08.871048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:09.896007 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:09.895959 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:09.995762 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:09.995729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:13.964975 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:13.964937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:13.965477 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:13.965397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:13.965477 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:13.965457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-h5hhl" Sep 11 02:09:14.039015 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.030738 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:14.039015 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.031079 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" podUID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" containerName="manager" containerID="cri-o://0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50" gracePeriod=10 Sep 11 02:09:14.041450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.041423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:14.274214 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.274191 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:14.367146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.367118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2cg8\" (UniqueName: \"kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8\") pod \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " Sep 11 02:09:14.367331 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.367184 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume\") pod \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\" (UID: \"8e277c81-5e57-4fef-a6fb-65b5d9d74748\") " Sep 11 02:09:14.367581 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.367558 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e277c81-5e57-4fef-a6fb-65b5d9d74748" (UID: "8e277c81-5e57-4fef-a6fb-65b5d9d74748"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:09:14.369199 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.369165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8" (OuterVolumeSpecName: "kube-api-access-c2cg8") pod "8e277c81-5e57-4fef-a6fb-65b5d9d74748" (UID: "8e277c81-5e57-4fef-a6fb-65b5d9d74748"). InnerVolumeSpecName "kube-api-access-c2cg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:09:14.372914 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.372880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:14.468420 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.468388 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e277c81-5e57-4fef-a6fb-65b5d9d74748-extensions-socket-volume\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:14.468420 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.468413 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2cg8\" (UniqueName: \"kubernetes.io/projected/8e277c81-5e57-4fef-a6fb-65b5d9d74748-kube-api-access-c2cg8\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:14.473010 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.472962 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:14.581110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.581065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:14.680351 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.680314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:14.970183 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:14.970106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tx6zj" Sep 11 02:09:15.018649 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.018617 2581 generic.go:356] "Generic (PLEG): container finished" podID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" containerID="0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50" exitCode=0 Sep 11 02:09:15.018818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.018657 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" Sep 11 02:09:15.018818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.018687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" event={"ID":"8e277c81-5e57-4fef-a6fb-65b5d9d74748","Type":"ContainerDied","Data":"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50"} Sep 11 02:09:15.018818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.018727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s" event={"ID":"8e277c81-5e57-4fef-a6fb-65b5d9d74748","Type":"ContainerDied","Data":"94077a99c30a084c9f618bbb12e242f3ee72d540f5f77bdb89f805e419569759"} Sep 11 02:09:15.018818 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.018748 2581 scope.go:117] "RemoveContainer" containerID="0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50" Sep 11 02:09:15.027741 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.027712 2581 scope.go:117] "RemoveContainer" containerID="0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50" Sep 11 02:09:15.028173 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:15.028145 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50\": container with ID starting with 0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50 not found: ID does not exist" containerID="0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50" Sep 11 02:09:15.028263 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.028180 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50"} err="failed to get container status \"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50\": rpc error: code = NotFound desc = could not find container \"0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50\": container with ID starting with 0aeb9b6e69f757498a4e5bce6de094cb234f4b4b2c8179f4227aa224f3b59c50 not found: ID does not exist" Sep 11 02:09:15.045177 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.045152 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:15.052716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.052687 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-55p6s"] Sep 11 02:09:15.218943 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:15.218910 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" path="/var/lib/kubelet/pods/8e277c81-5e57-4fef-a6fb-65b5d9d74748/volumes" Sep 11 02:09:21.023609 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:21.023570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:21.123007 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:21.122955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:27.577037 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:27.576934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:27.679110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:27.679073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:30.322634 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.322587 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc"] Sep 11 02:09:30.323387 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.323366 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" containerName="manager" Sep 11 02:09:30.323387 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.323387 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" containerName="manager" Sep 11 02:09:30.323544 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.323492 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e277c81-5e57-4fef-a6fb-65b5d9d74748" containerName="manager" Sep 11 02:09:30.338877 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.338849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:30.343518 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.343492 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc"] Sep 11 02:09:30.343639 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.343586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.345824 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.345801 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 11 02:09:30.345969 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.345944 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g2psx\"" Sep 11 02:09:30.386122 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386122 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2l7x\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-kube-api-access-w2l7x\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386349 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386538 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.386538 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.386392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487665 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2l7x\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-kube-api-access-w2l7x\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.487858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488222 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.487860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488222 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488222 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488150 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488377 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488430 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488476 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.488575 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.488557 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.490048 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.490028 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.490447 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.490429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.494749 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.494730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.494834 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.494793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2l7x\" (UniqueName: \"kubernetes.io/projected/8ba12083-4ea3-4a6d-8da5-bba1bb7ff990-kube-api-access-w2l7x\") pod \"maas-default-gateway-openshift-default-5ccb968c66-lktvc\" (UID: \"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.573584 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.573496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:30.654144 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.654105 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:30.674789 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.674757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:30.861736 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.861650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:30.927791 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:30.927736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc"] Sep 11 02:09:30.930457 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:30.930414 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba12083_4ea3_4a6d_8da5_bba1bb7ff990.slice/crio-06499ea8e8bb742e0d530a9a52848bfcae15007fd67564b035007eaf760db6b7 WatchSource:0}: Error finding container 06499ea8e8bb742e0d530a9a52848bfcae15007fd67564b035007eaf760db6b7: Status 404 returned error can't find the container with id 06499ea8e8bb742e0d530a9a52848bfcae15007fd67564b035007eaf760db6b7 Sep 11 02:09:31.091964 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:31.091931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" event={"ID":"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990","Type":"ContainerStarted","Data":"06499ea8e8bb742e0d530a9a52848bfcae15007fd67564b035007eaf760db6b7"} Sep 11 02:09:35.487229 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:35.487186 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:09:35.487485 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:35.487283 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:09:35.487485 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:35.487310 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:09:36.116788 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:36.116747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" event={"ID":"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990","Type":"ContainerStarted","Data":"423f93f61dbad948d28c8689fc0588a7431459729426ca248bcb59679b2f7779"} Sep 11 02:09:36.136534 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:36.136487 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podStartSLOduration=1.582086605 podStartE2EDuration="6.136472112s" totalImagesPullingTime="4.554385507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:36.134155119 +0000 UTC m=+455.410445709" watchObservedRunningTime="2026-09-11 02:09:36.136472112 +0000 UTC m=+455.412762703" Sep 11 02:09:36.654880 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:36.654838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:36.659607 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:36.659580 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:37.075324 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.075290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:37.087862 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.087829 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:37.091088 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.091071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.093245 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.093223 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 11 02:09:37.099160 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.099129 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:37.121567 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.121535 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:37.122474 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.122454 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:09:37.144141 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.144109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw2d4\" (UniqueName: \"kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.144309 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.144240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.180924 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.180893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:37.183842 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.183812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:37.245492 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.245456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw2d4\" (UniqueName: \"kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.245648 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.245520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.246112 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.246096 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.252722 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.252702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw2d4\" (UniqueName: \"kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4\") pod \"limitador-limitador-8588749977-5fn28\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.284021 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.283952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:37.402552 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.402456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:37.671958 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.671885 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:37.674996 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:37.674961 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f56cc24_5bbe_4b44_a3fc_328243cfe545.slice/crio-52013a2cd26ee90bc0e0c804027d7cb6cbe9f4bea57240903af1a0391cc735b6 WatchSource:0}: Error finding container 52013a2cd26ee90bc0e0c804027d7cb6cbe9f4bea57240903af1a0391cc735b6: Status 404 returned error can't find the container with id 52013a2cd26ee90bc0e0c804027d7cb6cbe9f4bea57240903af1a0391cc735b6 Sep 11 02:09:37.926115 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.926034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:37.983442 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:37.983408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:38.004114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.004066 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:09:38.008486 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.008462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:09:38.010503 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.010483 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spxhp\"" Sep 11 02:09:38.013454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.013432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:09:38.051881 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.051844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds58j\" (UniqueName: \"kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j\") pod \"authorino-59c974bd48-cgjxk\" (UID: \"1e27b1fd-8ad9-4613-b875-ba65a602e72a\") " pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:09:38.127491 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.127451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" event={"ID":"3f56cc24-5bbe-4b44-a3fc-328243cfe545","Type":"ContainerStarted","Data":"52013a2cd26ee90bc0e0c804027d7cb6cbe9f4bea57240903af1a0391cc735b6"} Sep 11 02:09:38.153286 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.153246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds58j\" (UniqueName: \"kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j\") pod \"authorino-59c974bd48-cgjxk\" (UID: \"1e27b1fd-8ad9-4613-b875-ba65a602e72a\") " pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:09:38.161639 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.161605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds58j\" (UniqueName: \"kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j\") pod \"authorino-59c974bd48-cgjxk\" (UID: \"1e27b1fd-8ad9-4613-b875-ba65a602e72a\") " pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:09:38.318693 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.318660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:09:38.592760 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.592098 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:09:38.607735 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:38.607699 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e27b1fd_8ad9_4613_b875_ba65a602e72a.slice/crio-7d667c53f7d16f94559fee6e790f89098758ccf4b432194606baea71284059d1 WatchSource:0}: Error finding container 7d667c53f7d16f94559fee6e790f89098758ccf4b432194606baea71284059d1: Status 404 returned error can't find the container with id 7d667c53f7d16f94559fee6e790f89098758ccf4b432194606baea71284059d1 Sep 11 02:09:38.968800 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:38.968714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:39.069546 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:39.069514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:39.133081 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:39.133045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" event={"ID":"3f56cc24-5bbe-4b44-a3fc-328243cfe545","Type":"ContainerStarted","Data":"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11"} Sep 11 02:09:39.133268 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:39.133194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:39.134364 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:39.134337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cgjxk" event={"ID":"1e27b1fd-8ad9-4613-b875-ba65a602e72a","Type":"ContainerStarted","Data":"7d667c53f7d16f94559fee6e790f89098758ccf4b432194606baea71284059d1"} Sep 11 02:09:39.148836 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:39.148792 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" podStartSLOduration=1.163856665 podStartE2EDuration="2.148778248s" totalImagesPullingTime="984.921583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:39.147090029 +0000 UTC m=+458.423380633" watchObservedRunningTime="2026-09-11 02:09:39.148778248 +0000 UTC m=+458.425068840" Sep 11 02:09:41.144981 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:41.144944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cgjxk" event={"ID":"1e27b1fd-8ad9-4613-b875-ba65a602e72a","Type":"ContainerStarted","Data":"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268"} Sep 11 02:09:41.159397 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:41.159347 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-cgjxk" podStartSLOduration=2.583772133 podStartE2EDuration="4.159331052s" totalImagesPullingTime="1.575558919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:41.157866729 +0000 UTC m=+460.434157322" watchObservedRunningTime="2026-09-11 02:09:41.159331052 +0000 UTC m=+460.435621643" Sep 11 02:09:50.141287 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:50.141257 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:51.191293 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.191254 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:51.191705 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.191430 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" podUID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" containerName="limitador" containerID="cri-o://6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11" gracePeriod=30 Sep 11 02:09:51.739629 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.739601 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:51.868079 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.868047 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw2d4\" (UniqueName: \"kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4\") pod \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " Sep 11 02:09:51.868260 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.868144 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file\") pod \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\" (UID: \"3f56cc24-5bbe-4b44-a3fc-328243cfe545\") " Sep 11 02:09:51.868506 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.868480 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file" (OuterVolumeSpecName: "config-file") pod "3f56cc24-5bbe-4b44-a3fc-328243cfe545" (UID: "3f56cc24-5bbe-4b44-a3fc-328243cfe545"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:09:51.870170 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.870148 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4" (OuterVolumeSpecName: "kube-api-access-tw2d4") pod "3f56cc24-5bbe-4b44-a3fc-328243cfe545" (UID: "3f56cc24-5bbe-4b44-a3fc-328243cfe545"). InnerVolumeSpecName "kube-api-access-tw2d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:09:51.969375 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.969324 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f56cc24-5bbe-4b44-a3fc-328243cfe545-config-file\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:51.969375 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:51.969367 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw2d4\" (UniqueName: \"kubernetes.io/projected/3f56cc24-5bbe-4b44-a3fc-328243cfe545-kube-api-access-tw2d4\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:09:52.196170 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.196082 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" containerID="6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11" exitCode=0 Sep 11 02:09:52.196170 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.196126 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" Sep 11 02:09:52.196641 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.196176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" event={"ID":"3f56cc24-5bbe-4b44-a3fc-328243cfe545","Type":"ContainerDied","Data":"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11"} Sep 11 02:09:52.196641 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.196236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fn28" event={"ID":"3f56cc24-5bbe-4b44-a3fc-328243cfe545","Type":"ContainerDied","Data":"52013a2cd26ee90bc0e0c804027d7cb6cbe9f4bea57240903af1a0391cc735b6"} Sep 11 02:09:52.196641 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.196267 2581 scope.go:117] "RemoveContainer" containerID="6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11" Sep 11 02:09:52.204754 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.204733 2581 scope.go:117] "RemoveContainer" containerID="6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11" Sep 11 02:09:52.205047 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:09:52.205030 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11\": container with ID starting with 6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11 not found: ID does not exist" containerID="6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11" Sep 11 02:09:52.205118 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.205056 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11"} err="failed to get container status \"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11\": rpc error: code = NotFound desc = could not find container \"6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11\": container with ID starting with 6056f0bbff99f578755dfab5a8be82ab07271b0cabceba1e35e4a8dcc68f0f11 not found: ID does not exist" Sep 11 02:09:52.216865 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.216842 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:52.218855 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:52.218835 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fn28"] Sep 11 02:09:53.219422 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.219384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:53.220648 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.220623 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" path="/var/lib/kubelet/pods/3f56cc24-5bbe-4b44-a3fc-328243cfe545/volumes" Sep 11 02:09:53.318775 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.318746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:53.628930 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.628892 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-skfc5"] Sep 11 02:09:53.629244 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.629231 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" containerName="limitador" Sep 11 02:09:53.629307 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.629245 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" containerName="limitador" Sep 11 02:09:53.629307 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.629304 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f56cc24-5bbe-4b44-a3fc-328243cfe545" containerName="limitador" Sep 11 02:09:53.633582 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.633562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.635773 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.635741 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4ddht\"" Sep 11 02:09:53.635895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.635745 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 11 02:09:53.635895 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.635814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 11 02:09:53.636370 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.636352 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 11 02:09:53.640299 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.640280 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-skfc5"] Sep 11 02:09:53.666103 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.666075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:09:53.685208 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.685184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-data\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.685330 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.685241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chggc\" (UniqueName: \"kubernetes.io/projected/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-kube-api-access-chggc\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.785982 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.785941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chggc\" (UniqueName: \"kubernetes.io/projected/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-kube-api-access-chggc\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.786208 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.786071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-data\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.786450 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.786429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-data\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.798916 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.798883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chggc\" (UniqueName: \"kubernetes.io/projected/ba501ff1-6930-4c62-b76e-8ff3b6b4b098-kube-api-access-chggc\") pod \"postgres-69fb4594cf-skfc5\" (UID: \"ba501ff1-6930-4c62-b76e-8ff3b6b4b098\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:53.945440 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:53.945335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:54.212385 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:54.212211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-skfc5"] Sep 11 02:09:54.215135 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:09:54.215105 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba501ff1_6930_4c62_b76e_8ff3b6b4b098.slice/crio-d83dfe0e541deb26a92ac3f989db6e075a7843e2a30e924670bdbd29bbe921d0 WatchSource:0}: Error finding container d83dfe0e541deb26a92ac3f989db6e075a7843e2a30e924670bdbd29bbe921d0: Status 404 returned error can't find the container with id d83dfe0e541deb26a92ac3f989db6e075a7843e2a30e924670bdbd29bbe921d0 Sep 11 02:09:55.219516 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:55.219470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" event={"ID":"ba501ff1-6930-4c62-b76e-8ff3b6b4b098","Type":"ContainerStarted","Data":"d83dfe0e541deb26a92ac3f989db6e075a7843e2a30e924670bdbd29bbe921d0"} Sep 11 02:09:57.224664 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:57.224631 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" event={"ID":"ba501ff1-6930-4c62-b76e-8ff3b6b4b098","Type":"ContainerStarted","Data":"f38b30025641c905f11cd1df2c37388d78ab4c363b602b3c6115a6a68d4664ff"} Sep 11 02:09:57.225053 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:57.224764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:09:57.239506 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:09:57.239453 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" podStartSLOduration=2.284918975 podStartE2EDuration="4.23943722s" totalImagesPullingTime="1.954518245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:09:57.238247989 +0000 UTC m=+476.514538601" watchObservedRunningTime="2026-09-11 02:09:57.23943722 +0000 UTC m=+476.515727812" Sep 11 02:10:03.257051 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:03.257019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-skfc5" Sep 11 02:10:03.538411 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:03.538316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:04.014761 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.014732 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77d46757dc-t2rmj"] Sep 11 02:10:04.018465 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.018442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.027911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.027874 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77d46757dc-t2rmj"] Sep 11 02:10:04.077225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.077183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:04.117394 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.117362 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77d46757dc-t2rmj"] Sep 11 02:10:04.117629 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:10:04.117611 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xflpk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-77d46757dc-t2rmj" podUID="0103b132-da43-4db4-96e3-c72e1567f551" Sep 11 02:10:04.175716 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.175681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xflpk\" (UniqueName: \"kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk\") pod \"authorino-77d46757dc-t2rmj\" (UID: \"0103b132-da43-4db4-96e3-c72e1567f551\") " pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.253935 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.253905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.259863 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.259840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.276789 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.276715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xflpk\" (UniqueName: \"kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk\") pod \"authorino-77d46757dc-t2rmj\" (UID: \"0103b132-da43-4db4-96e3-c72e1567f551\") " pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.285722 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.285688 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xflpk\" (UniqueName: \"kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk\") pod \"authorino-77d46757dc-t2rmj\" (UID: \"0103b132-da43-4db4-96e3-c72e1567f551\") " pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:04.377793 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.377750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xflpk\" (UniqueName: \"kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk\") pod \"0103b132-da43-4db4-96e3-c72e1567f551\" (UID: \"0103b132-da43-4db4-96e3-c72e1567f551\") " Sep 11 02:10:04.379857 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.379833 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk" (OuterVolumeSpecName: "kube-api-access-xflpk") pod "0103b132-da43-4db4-96e3-c72e1567f551" (UID: "0103b132-da43-4db4-96e3-c72e1567f551"). InnerVolumeSpecName "kube-api-access-xflpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:10:04.478566 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:04.478531 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xflpk\" (UniqueName: \"kubernetes.io/projected/0103b132-da43-4db4-96e3-c72e1567f551-kube-api-access-xflpk\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:10:05.258661 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:05.258632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d46757dc-t2rmj" Sep 11 02:10:05.282012 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:05.281965 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77d46757dc-t2rmj"] Sep 11 02:10:05.285922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:05.285896 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77d46757dc-t2rmj"] Sep 11 02:10:06.291120 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.291086 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:10:06.291567 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.291286 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-cgjxk" podUID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" containerName="authorino" containerID="cri-o://eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268" gracePeriod=30 Sep 11 02:10:06.551294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.551225 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:10:06.698873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.698845 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds58j\" (UniqueName: \"kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j\") pod \"1e27b1fd-8ad9-4613-b875-ba65a602e72a\" (UID: \"1e27b1fd-8ad9-4613-b875-ba65a602e72a\") " Sep 11 02:10:06.700832 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.700806 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j" (OuterVolumeSpecName: "kube-api-access-ds58j") pod "1e27b1fd-8ad9-4613-b875-ba65a602e72a" (UID: "1e27b1fd-8ad9-4613-b875-ba65a602e72a"). InnerVolumeSpecName "kube-api-access-ds58j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:10:06.800422 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:06.800389 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds58j\" (UniqueName: \"kubernetes.io/projected/1e27b1fd-8ad9-4613-b875-ba65a602e72a-kube-api-access-ds58j\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:10:07.219685 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.219650 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0103b132-da43-4db4-96e3-c72e1567f551" path="/var/lib/kubelet/pods/0103b132-da43-4db4-96e3-c72e1567f551/volumes" Sep 11 02:10:07.269173 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.269135 2581 generic.go:356] "Generic (PLEG): container finished" podID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" containerID="eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268" exitCode=0 Sep 11 02:10:07.269329 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.269185 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cgjxk" Sep 11 02:10:07.269329 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.269222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cgjxk" event={"ID":"1e27b1fd-8ad9-4613-b875-ba65a602e72a","Type":"ContainerDied","Data":"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268"} Sep 11 02:10:07.269329 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.269262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cgjxk" event={"ID":"1e27b1fd-8ad9-4613-b875-ba65a602e72a","Type":"ContainerDied","Data":"7d667c53f7d16f94559fee6e790f89098758ccf4b432194606baea71284059d1"} Sep 11 02:10:07.269329 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.269278 2581 scope.go:117] "RemoveContainer" containerID="eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268" Sep 11 02:10:07.277185 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.277168 2581 scope.go:117] "RemoveContainer" containerID="eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268" Sep 11 02:10:07.277498 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:10:07.277476 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268\": container with ID starting with eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268 not found: ID does not exist" containerID="eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268" Sep 11 02:10:07.277547 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.277507 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268"} err="failed to get container status \"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268\": rpc error: code = NotFound desc = could not find container \"eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268\": container with ID starting with eb5b8f3cc9178059357c22806681fddff62f442bdde9b80efc4adc4681d3e268 not found: ID does not exist" Sep 11 02:10:07.283019 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.282981 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:10:07.286731 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:07.286710 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cgjxk"] Sep 11 02:10:09.219223 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:09.219182 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" path="/var/lib/kubelet/pods/1e27b1fd-8ad9-4613-b875-ba65a602e72a/volumes" Sep 11 02:10:10.960791 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.960759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:10.978788 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.978761 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:10.979099 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.979086 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" containerName="authorino" Sep 11 02:10:10.979157 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.979115 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" containerName="authorino" Sep 11 02:10:10.979191 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.979179 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e27b1fd-8ad9-4613-b875-ba65a602e72a" containerName="authorino" Sep 11 02:10:10.983934 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.983898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:10.986391 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.986364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 11 02:10:10.986515 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.986402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5q28m\"" Sep 11 02:10:10.986515 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.986402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 11 02:10:10.987050 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.987032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 11 02:10:10.991768 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:10.991743 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:11.060742 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.060711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:11.136079 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.136039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.136251 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.136140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltpnw\" (UniqueName: \"kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.136251 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.136164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.155621 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.155591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:11.160146 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.160121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74f949ccff-zxjsl"] Sep 11 02:10:11.162346 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.162327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.174319 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.174296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74f949ccff-zxjsl"] Sep 11 02:10:11.237077 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.236975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.237248 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.237079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltpnw\" (UniqueName: \"kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.237248 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.237106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.239417 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.239393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.239509 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.239418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.244468 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.244445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltpnw\" (UniqueName: \"kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw\") pod \"maas-controller-798d4879bd-whsdb\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.248119 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.248094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:11.294728 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.294701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:11.338084 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.338051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-webhook-cert\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.338263 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.338192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79nn\" (UniqueName: \"kubernetes.io/projected/bcd7f967-f684-40c2-84f4-23bf03c24230-kube-api-access-n79nn\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.338263 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.338223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-metrics-certs\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.439189 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.439154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-webhook-cert\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.439369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.439240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n79nn\" (UniqueName: \"kubernetes.io/projected/bcd7f967-f684-40c2-84f4-23bf03c24230-kube-api-access-n79nn\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.439369 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.439262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-metrics-certs\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.441599 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.441565 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-webhook-cert\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.441599 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.441594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd7f967-f684-40c2-84f4-23bf03c24230-metrics-certs\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.446821 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.446803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79nn\" (UniqueName: \"kubernetes.io/projected/bcd7f967-f684-40c2-84f4-23bf03c24230-kube-api-access-n79nn\") pod \"maas-controller-74f949ccff-zxjsl\" (UID: \"bcd7f967-f684-40c2-84f4-23bf03c24230\") " pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.471833 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.471799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:11.565655 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.565621 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:11.569350 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:10:11.569327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d970664_2dc8_4aa4_b96b_d82c628d05ac.slice/crio-0c59ec8ab583e8a6b3520a82f930add5904a2d76a592dbf69ea1e3d5804f7996 WatchSource:0}: Error finding container 0c59ec8ab583e8a6b3520a82f930add5904a2d76a592dbf69ea1e3d5804f7996: Status 404 returned error can't find the container with id 0c59ec8ab583e8a6b3520a82f930add5904a2d76a592dbf69ea1e3d5804f7996 Sep 11 02:10:11.739403 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:11.739332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74f949ccff-zxjsl"] Sep 11 02:10:11.741516 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:10:11.741481 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd7f967_f684_40c2_84f4_23bf03c24230.slice/crio-9642f683c7f29c759985a585a3132375000e05f18b8ba6f7531f2f83396b61ab WatchSource:0}: Error finding container 9642f683c7f29c759985a585a3132375000e05f18b8ba6f7531f2f83396b61ab: Status 404 returned error can't find the container with id 9642f683c7f29c759985a585a3132375000e05f18b8ba6f7531f2f83396b61ab Sep 11 02:10:12.298679 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:12.298639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74f949ccff-zxjsl" event={"ID":"bcd7f967-f684-40c2-84f4-23bf03c24230","Type":"ContainerStarted","Data":"9642f683c7f29c759985a585a3132375000e05f18b8ba6f7531f2f83396b61ab"} Sep 11 02:10:12.300712 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:12.300680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798d4879bd-whsdb" event={"ID":"8d970664-2dc8-4aa4-b96b-d82c628d05ac","Type":"ContainerStarted","Data":"0c59ec8ab583e8a6b3520a82f930add5904a2d76a592dbf69ea1e3d5804f7996"} Sep 11 02:10:14.312413 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.312382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74f949ccff-zxjsl" event={"ID":"bcd7f967-f684-40c2-84f4-23bf03c24230","Type":"ContainerStarted","Data":"bb83ef1bf16eefae1d2c714bda46c5e122f7c291e2a79fc8cee1224eb7c8a763"} Sep 11 02:10:14.312809 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.312558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:14.314008 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.313971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798d4879bd-whsdb" event={"ID":"8d970664-2dc8-4aa4-b96b-d82c628d05ac","Type":"ContainerStarted","Data":"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177"} Sep 11 02:10:14.314133 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.314117 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:14.329397 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.329333 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74f949ccff-zxjsl" podStartSLOduration=0.820602896 podStartE2EDuration="3.3293098s" totalImagesPullingTime="2.508706904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:10:14.327128088 +0000 UTC m=+493.603418707" watchObservedRunningTime="2026-09-11 02:10:14.3293098 +0000 UTC m=+493.605600393" Sep 11 02:10:14.343493 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.343442 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-798d4879bd-whsdb" podStartSLOduration=1.672526413 podStartE2EDuration="4.343424478s" totalImagesPullingTime="2.670898065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:10:14.341625644 +0000 UTC m=+493.617916247" watchObservedRunningTime="2026-09-11 02:10:14.343424478 +0000 UTC m=+493.619715070" Sep 11 02:10:14.404981 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.404938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:14.504907 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:14.504813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:25.321043 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.321005 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74f949ccff-zxjsl" Sep 11 02:10:25.321412 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.321175 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:25.378705 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.378671 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:25.379444 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.379410 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-798d4879bd-whsdb" podUID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" containerName="manager" containerID="cri-o://c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177" gracePeriod=30 Sep 11 02:10:25.621729 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.621705 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:25.656228 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.656197 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs\") pod \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " Sep 11 02:10:25.656390 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.656238 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert\") pod \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " Sep 11 02:10:25.656390 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.656262 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltpnw\" (UniqueName: \"kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw\") pod \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\" (UID: \"8d970664-2dc8-4aa4-b96b-d82c628d05ac\") " Sep 11 02:10:25.658444 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.658416 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw" (OuterVolumeSpecName: "kube-api-access-ltpnw") pod "8d970664-2dc8-4aa4-b96b-d82c628d05ac" (UID: "8d970664-2dc8-4aa4-b96b-d82c628d05ac"). InnerVolumeSpecName "kube-api-access-ltpnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:10:25.658572 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.658440 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8d970664-2dc8-4aa4-b96b-d82c628d05ac" (UID: "8d970664-2dc8-4aa4-b96b-d82c628d05ac"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:10:25.658572 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.658523 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8d970664-2dc8-4aa4-b96b-d82c628d05ac" (UID: "8d970664-2dc8-4aa4-b96b-d82c628d05ac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:10:25.757676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.757644 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-metrics-certs\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:10:25.757676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.757672 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d970664-2dc8-4aa4-b96b-d82c628d05ac-webhook-cert\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:10:25.757676 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:25.757681 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltpnw\" (UniqueName: \"kubernetes.io/projected/8d970664-2dc8-4aa4-b96b-d82c628d05ac-kube-api-access-ltpnw\") on node \"ip-10-0-135-234.ec2.internal\" DevicePath \"\"" Sep 11 02:10:26.371674 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.371638 2581 generic.go:356] "Generic (PLEG): container finished" podID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" containerID="c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177" exitCode=0 Sep 11 02:10:26.372102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.371687 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798d4879bd-whsdb" Sep 11 02:10:26.372102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.371704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798d4879bd-whsdb" event={"ID":"8d970664-2dc8-4aa4-b96b-d82c628d05ac","Type":"ContainerDied","Data":"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177"} Sep 11 02:10:26.372102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.371758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798d4879bd-whsdb" event={"ID":"8d970664-2dc8-4aa4-b96b-d82c628d05ac","Type":"ContainerDied","Data":"0c59ec8ab583e8a6b3520a82f930add5904a2d76a592dbf69ea1e3d5804f7996"} Sep 11 02:10:26.372102 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.371787 2581 scope.go:117] "RemoveContainer" containerID="c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177" Sep 11 02:10:26.380696 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.380576 2581 scope.go:117] "RemoveContainer" containerID="c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177" Sep 11 02:10:26.380870 ip-10-0-135-234 kubenswrapper[2581]: E0911 02:10:26.380853 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177\": container with ID starting with c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177 not found: ID does not exist" containerID="c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177" Sep 11 02:10:26.380912 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.380877 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177"} err="failed to get container status \"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177\": rpc error: code = NotFound desc = could not find container \"c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177\": container with ID starting with c44431ae91917925bdb6e093eed4d66f241133a364402dacd487ceea9a9c6177 not found: ID does not exist" Sep 11 02:10:26.391260 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.391236 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:26.394612 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:26.394591 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-798d4879bd-whsdb"] Sep 11 02:10:27.219424 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:27.219387 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" path="/var/lib/kubelet/pods/8d970664-2dc8-4aa4-b96b-d82c628d05ac/volumes" Sep 11 02:10:45.997384 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:45.997334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:46.097322 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:46.097287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:47.369684 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.369641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:47.466430 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.466396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:47.629249 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.629177 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-db9df5966-6rhrv"] Sep 11 02:10:47.629540 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.629525 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" containerName="manager" Sep 11 02:10:47.629627 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.629542 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" containerName="manager" Sep 11 02:10:47.629670 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.629628 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d970664-2dc8-4aa4-b96b-d82c628d05ac" containerName="manager" Sep 11 02:10:47.634675 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.634654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.637017 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.636968 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 11 02:10:47.637131 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.637006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 11 02:10:47.637131 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.637116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7cbgc\"" Sep 11 02:10:47.641664 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.641637 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db9df5966-6rhrv"] Sep 11 02:10:47.754036 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.753969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-metrics-certs\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.754236 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.754105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-maas-api-tls\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.754236 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.754156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c6579-5390-48d3-9e47-91fae93643fa-openshift-service-ca\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.754236 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.754192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvf7\" (UniqueName: \"kubernetes.io/projected/740c6579-5390-48d3-9e47-91fae93643fa-kube-api-access-xlvf7\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.780684 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.780649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:47.855077 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.855038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-maas-api-tls\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.855298 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.855086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c6579-5390-48d3-9e47-91fae93643fa-openshift-service-ca\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.855298 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.855115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvf7\" (UniqueName: \"kubernetes.io/projected/740c6579-5390-48d3-9e47-91fae93643fa-kube-api-access-xlvf7\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.855298 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.855168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-metrics-certs\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.855953 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.855926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c6579-5390-48d3-9e47-91fae93643fa-openshift-service-ca\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.857762 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.857739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-metrics-certs\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.858032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.857973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c6579-5390-48d3-9e47-91fae93643fa-maas-api-tls\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.862128 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.862112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvf7\" (UniqueName: \"kubernetes.io/projected/740c6579-5390-48d3-9e47-91fae93643fa-kube-api-access-xlvf7\") pod \"maas-api-db9df5966-6rhrv\" (UID: \"740c6579-5390-48d3-9e47-91fae93643fa\") " pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:47.896448 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.896376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:47.946836 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:47.946809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:48.000700 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.000194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:48.095524 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.095480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:48.095970 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.095950 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs"] Sep 11 02:10:48.098351 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.098335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.100545 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.100525 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 11 02:10:48.100640 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.100623 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bsb24\"" Sep 11 02:10:48.109936 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.109910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs"] Sep 11 02:10:48.120813 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.120785 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-krz9n"] Sep 11 02:10:48.123171 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.123151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.132528 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.132508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-krz9n"] Sep 11 02:10:48.230750 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.230666 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db9df5966-6rhrv"] Sep 11 02:10:48.234588 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:10:48.234546 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740c6579_5390_48d3_9e47_91fae93643fa.slice/crio-8bb766c96ba737445d259b1cf5f415214a5b8e8f4d50a4f16438312c780f17d6 WatchSource:0}: Error finding container 8bb766c96ba737445d259b1cf5f415214a5b8e8f4d50a4f16438312c780f17d6: Status 404 returned error can't find the container with id 8bb766c96ba737445d259b1cf5f415214a5b8e8f4d50a4f16438312c780f17d6 Sep 11 02:10:48.258819 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.258783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c965bc0a-6ff1-4336-9261-f67e2635af55-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.258930 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.258889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b20906-ac5d-45cd-b4c8-3169f1541633-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.258930 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.258919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4sxc\" (UniqueName: \"kubernetes.io/projected/72b20906-ac5d-45cd-b4c8-3169f1541633-kube-api-access-q4sxc\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.259049 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.259033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8dd\" (UniqueName: \"kubernetes.io/projected/c965bc0a-6ff1-4336-9261-f67e2635af55-kube-api-access-sl8dd\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.359851 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.359812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b20906-ac5d-45cd-b4c8-3169f1541633-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.359851 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.359851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4sxc\" (UniqueName: \"kubernetes.io/projected/72b20906-ac5d-45cd-b4c8-3169f1541633-kube-api-access-q4sxc\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.360154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.359976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8dd\" (UniqueName: \"kubernetes.io/projected/c965bc0a-6ff1-4336-9261-f67e2635af55-kube-api-access-sl8dd\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.360154 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.360092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c965bc0a-6ff1-4336-9261-f67e2635af55-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.360714 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.360690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b20906-ac5d-45cd-b4c8-3169f1541633-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.361032 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.361008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c965bc0a-6ff1-4336-9261-f67e2635af55-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.367554 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.367531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4sxc\" (UniqueName: \"kubernetes.io/projected/72b20906-ac5d-45cd-b4c8-3169f1541633-kube-api-access-q4sxc\") pod \"payload-pre-processing-59fbc47bf8-hk9gs\" (UID: \"72b20906-ac5d-45cd-b4c8-3169f1541633\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.367635 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.367551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8dd\" (UniqueName: \"kubernetes.io/projected/c965bc0a-6ff1-4336-9261-f67e2635af55-kube-api-access-sl8dd\") pod \"payload-processing-5b54b7fbb7-krz9n\" (UID: \"c965bc0a-6ff1-4336-9261-f67e2635af55\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.409605 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.409577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:48.433664 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.433636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:48.474050 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.474012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" event={"ID":"740c6579-5390-48d3-9e47-91fae93643fa","Type":"ContainerStarted","Data":"8bb766c96ba737445d259b1cf5f415214a5b8e8f4d50a4f16438312c780f17d6"} Sep 11 02:10:48.683689 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.683655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs"] Sep 11 02:10:48.687546 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:10:48.687503 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b20906_ac5d_45cd_b4c8_3169f1541633.slice/crio-524be469b2f1569ee3ada974a8b8dd181de468cbbb092a9a10cf7a4f62db1e8e WatchSource:0}: Error finding container 524be469b2f1569ee3ada974a8b8dd181de468cbbb092a9a10cf7a4f62db1e8e: Status 404 returned error can't find the container with id 524be469b2f1569ee3ada974a8b8dd181de468cbbb092a9a10cf7a4f62db1e8e Sep 11 02:10:48.712398 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:48.712370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-krz9n"] Sep 11 02:10:48.715379 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:10:48.715354 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc965bc0a_6ff1_4336_9261_f67e2635af55.slice/crio-8e1d5d8b96d48806640215e7f2d269eb45c7843f4c4e19a8a05ff7fbb8906953 WatchSource:0}: Error finding container 8e1d5d8b96d48806640215e7f2d269eb45c7843f4c4e19a8a05ff7fbb8906953: Status 404 returned error can't find the container with id 8e1d5d8b96d48806640215e7f2d269eb45c7843f4c4e19a8a05ff7fbb8906953 Sep 11 02:10:49.484366 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:49.484286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" event={"ID":"72b20906-ac5d-45cd-b4c8-3169f1541633","Type":"ContainerStarted","Data":"524be469b2f1569ee3ada974a8b8dd181de468cbbb092a9a10cf7a4f62db1e8e"} Sep 11 02:10:49.486678 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:49.486574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" event={"ID":"c965bc0a-6ff1-4336-9261-f67e2635af55","Type":"ContainerStarted","Data":"8e1d5d8b96d48806640215e7f2d269eb45c7843f4c4e19a8a05ff7fbb8906953"} Sep 11 02:10:51.499263 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.499227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" event={"ID":"740c6579-5390-48d3-9e47-91fae93643fa","Type":"ContainerStarted","Data":"dd59313a9d926177b326da0780f25efd25b5f19a7db82336c7da81d665d391fc"} Sep 11 02:10:51.499733 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.499293 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:51.500921 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.500897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" event={"ID":"c965bc0a-6ff1-4336-9261-f67e2635af55","Type":"ContainerStarted","Data":"a26b4cf9dca2a2fd26515a3938da0a3e083d300b9c4886116fbea1a1073a4b4a"} Sep 11 02:10:51.501047 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.500948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:10:51.506184 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.506108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" event={"ID":"72b20906-ac5d-45cd-b4c8-3169f1541633","Type":"ContainerStarted","Data":"aa9c72a6e5917b1d3064d6804730cc7cb9d1de0aad7c6a6df982189e369789f0"} Sep 11 02:10:51.506297 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.506288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:10:51.519225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.519163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" podStartSLOduration=2.218521049 podStartE2EDuration="4.519144897s" totalImagesPullingTime="2.300623848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:10:51.518808944 +0000 UTC m=+530.795099559" watchObservedRunningTime="2026-09-11 02:10:51.519144897 +0000 UTC m=+530.795435490" Sep 11 02:10:51.535316 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.535261 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" podStartSLOduration=0.987467893 podStartE2EDuration="3.535231802s" totalImagesPullingTime="2.547763909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:10:51.534804313 +0000 UTC m=+530.811094929" watchObservedRunningTime="2026-09-11 02:10:51.535231802 +0000 UTC m=+530.811522394" Sep 11 02:10:51.555202 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:51.555143 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" podStartSLOduration=0.987596657 podStartE2EDuration="3.555123197s" totalImagesPullingTime="2.56752654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:10:51.552637675 +0000 UTC m=+530.828928292" watchObservedRunningTime="2026-09-11 02:10:51.555123197 +0000 UTC m=+530.831413790" Sep 11 02:10:57.517383 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.517300 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-db9df5966-6rhrv" Sep 11 02:10:57.540967 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.540928 2581 generic.go:356] "Generic (PLEG): container finished" podID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerID="423f93f61dbad948d28c8689fc0588a7431459729426ca248bcb59679b2f7779" exitCode=0 Sep 11 02:10:57.541199 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.541023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" event={"ID":"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990","Type":"ContainerDied","Data":"423f93f61dbad948d28c8689fc0588a7431459729426ca248bcb59679b2f7779"} Sep 11 02:10:57.541719 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.541688 2581 scope.go:117] "RemoveContainer" containerID="423f93f61dbad948d28c8689fc0588a7431459729426ca248bcb59679b2f7779" Sep 11 02:10:57.542975 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.542931 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:10:57.543150 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.543030 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:10:57.543150 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:57.543072 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 11 02:10:58.527243 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.527202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:58.548640 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.548603 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" event={"ID":"8ba12083-4ea3-4a6d-8da5-bba1bb7ff990","Type":"ContainerStarted","Data":"f88cd054056f44233eab96f427672dc84eee1dd6567a32b6311b9ab652968bc9"} Sep 11 02:10:58.593631 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.593601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:10:58.654563 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.654537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:10:58.654738 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.654714 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:10:58.654789 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:58.654771 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:10:59.655371 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:59.655332 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:10:59.655873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:10:59.655394 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:11:00.654911 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:00.654868 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:11:00.655136 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:00.654934 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:11:01.655294 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:01.655254 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:11:01.655670 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:01.655312 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:11:02.519224 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:02.519187 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hk9gs" Sep 11 02:11:02.520185 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:02.520157 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-krz9n" Sep 11 02:11:02.654923 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:02.654882 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:11:02.655093 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:02.654941 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:11:03.654945 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:03.654905 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-lktvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 11 02:11:03.655341 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:03.655005 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" podUID="8ba12083-4ea3-4a6d-8da5-bba1bb7ff990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 11 02:11:04.659221 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:04.659189 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:11:04.659584 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:04.659489 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:11:04.660151 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:04.660132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lktvc" Sep 11 02:11:10.209454 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:10.209420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:16.593095 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:16.593054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:20.793816 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:20.793763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:20.842889 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:20.842859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:21.866723 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.866690 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx"] Sep 11 02:11:21.873286 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.873263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.875757 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.875729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 11 02:11:21.876562 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.876539 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 11 02:11:21.876668 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.876556 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 11 02:11:21.876844 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.876831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kjqhg\"" Sep 11 02:11:21.879616 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.879592 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx"] Sep 11 02:11:21.896337 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.896306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:21.958057 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.958057 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.958225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.958225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.958225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8p6\" (UniqueName: \"kubernetes.io/projected/49bf266e-ee7f-4fd2-8e11-34040facbbb6-kube-api-access-vr8p6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:21.958225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:21.958223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059021 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.058967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059172 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059172 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059172 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059172 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8p6\" (UniqueName: \"kubernetes.io/projected/49bf266e-ee7f-4fd2-8e11-34040facbbb6-kube-api-access-vr8p6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059372 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059446 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059534 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.059602 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.059510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.061443 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.061417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49bf266e-ee7f-4fd2-8e11-34040facbbb6-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.061620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.061600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49bf266e-ee7f-4fd2-8e11-34040facbbb6-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.066532 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.066510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8p6\" (UniqueName: \"kubernetes.io/projected/49bf266e-ee7f-4fd2-8e11-34040facbbb6-kube-api-access-vr8p6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx\" (UID: \"49bf266e-ee7f-4fd2-8e11-34040facbbb6\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.184368 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.184301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:22.458180 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.458151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx"] Sep 11 02:11:22.460821 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:11:22.460794 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49bf266e_ee7f_4fd2_8e11_34040facbbb6.slice/crio-2259238c57a0c76ad37990f8ef175b9806bbb7edf1be7684037bcfe560d80f2e WatchSource:0}: Error finding container 2259238c57a0c76ad37990f8ef175b9806bbb7edf1be7684037bcfe560d80f2e: Status 404 returned error can't find the container with id 2259238c57a0c76ad37990f8ef175b9806bbb7edf1be7684037bcfe560d80f2e Sep 11 02:11:22.658382 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:22.658341 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" event={"ID":"49bf266e-ee7f-4fd2-8e11-34040facbbb6","Type":"ContainerStarted","Data":"2259238c57a0c76ad37990f8ef175b9806bbb7edf1be7684037bcfe560d80f2e"} Sep 11 02:11:23.665548 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:23.665506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" event={"ID":"49bf266e-ee7f-4fd2-8e11-34040facbbb6","Type":"ContainerStarted","Data":"7cd640e09edcfcd1f53361f660ff8cf293a18d7fe19ad05aac3ffb7209aee5fd"} Sep 11 02:11:23.681805 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:23.681749 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" podStartSLOduration=1.687971175 podStartE2EDuration="2.681734512s" totalImagesPullingTime="993.763337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:11:23.680423413 +0000 UTC m=+562.956714027" watchObservedRunningTime="2026-09-11 02:11:23.681734512 +0000 UTC m=+562.958025104" Sep 11 02:11:29.199658 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:29.199623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:11:32.184642 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:32.184606 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:32.185037 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:32.184711 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:32.196901 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:32.196869 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:32.717801 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:32.717771 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx" Sep 11 02:11:40.868589 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:11:40.868550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:12:02.787461 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:12:02.787394 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:12:04.847525 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:12:04.847485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:12:09.877922 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:12:09.877884 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:11.998825 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:11.998790 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b7c787984-782sg"] Sep 11 02:13:12.002097 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.002078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.005044 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.005020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 11 02:13:12.005044 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.005032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-spxhp\"" Sep 11 02:13:12.013142 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.013117 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7c787984-782sg"] Sep 11 02:13:12.086939 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.086903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9t27\" (UniqueName: \"kubernetes.io/projected/2f3318d4-9740-428d-9a3e-7ee5019020fe-kube-api-access-f9t27\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.086939 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.086942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f3318d4-9740-428d-9a3e-7ee5019020fe-tls-cert\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.133296 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.133253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:12.188134 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.188098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9t27\" (UniqueName: \"kubernetes.io/projected/2f3318d4-9740-428d-9a3e-7ee5019020fe-kube-api-access-f9t27\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.188134 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.188131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f3318d4-9740-428d-9a3e-7ee5019020fe-tls-cert\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.190819 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.190792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f3318d4-9740-428d-9a3e-7ee5019020fe-tls-cert\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.194880 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.194842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9t27\" (UniqueName: \"kubernetes.io/projected/2f3318d4-9740-428d-9a3e-7ee5019020fe-kube-api-access-f9t27\") pod \"authorino-5b7c787984-782sg\" (UID: \"2f3318d4-9740-428d-9a3e-7ee5019020fe\") " pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.315847 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.315813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7c787984-782sg" Sep 11 02:13:12.585026 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.584997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7c787984-782sg"] Sep 11 02:13:12.587225 ip-10-0-135-234 kubenswrapper[2581]: W0911 02:13:12.587195 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f3318d4_9740_428d_9a3e_7ee5019020fe.slice/crio-bd116481a6c84a797ef9f1f997a9b9ee4c09660e9bf1bdd61fd146e3eddf2185 WatchSource:0}: Error finding container bd116481a6c84a797ef9f1f997a9b9ee4c09660e9bf1bdd61fd146e3eddf2185: Status 404 returned error can't find the container with id bd116481a6c84a797ef9f1f997a9b9ee4c09660e9bf1bdd61fd146e3eddf2185 Sep 11 02:13:12.588674 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:12.588659 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:13:13.176293 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:13.176262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7c787984-782sg" event={"ID":"2f3318d4-9740-428d-9a3e-7ee5019020fe","Type":"ContainerStarted","Data":"bd116481a6c84a797ef9f1f997a9b9ee4c09660e9bf1bdd61fd146e3eddf2185"} Sep 11 02:13:14.183548 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:14.183508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7c787984-782sg" event={"ID":"2f3318d4-9740-428d-9a3e-7ee5019020fe","Type":"ContainerStarted","Data":"1ae39edde65bd35f45b20e7eb31109ddb6885acfbc3a7cdbbdcfe6f60920e96e"} Sep 11 02:13:14.200654 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:14.200606 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b7c787984-782sg" podStartSLOduration=2.394570777 podStartE2EDuration="3.200589195s" totalImagesPullingTime="806.018418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:13:14.198232624 +0000 UTC m=+673.474523231" watchObservedRunningTime="2026-09-11 02:13:14.200589195 +0000 UTC m=+673.476879787" Sep 11 02:13:14.709493 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:14.709457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:14.806754 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:14.806719 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:15.803313 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:15.803273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:15.901807 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:15.901776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:13:47.103622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:13:47.103590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:16:06.654859 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:16:06.654827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:17:00.043223 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:17:00.043140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:17:00.144422 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:17:00.144390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:06.060407 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:06.060360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:07.562641 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:07.562611 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:24.577690 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:24.577656 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7c787984-782sg_2f3318d4-9740-428d-9a3e-7ee5019020fe/authorino/0.log" Sep 11 02:19:30.005329 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:30.005293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zw4vf_eb0ae041-de38-4ab6-922c-82f75a28fd49/manager/0.log" Sep 11 02:19:30.126468 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:30.126432 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gq95l_c7046489-7e7c-4e21-8c95-b02837101ff9/manager/0.log" Sep 11 02:19:30.259884 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:30.259796 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74f949ccff-zxjsl_bcd7f967-f684-40c2-84f4-23bf03c24230/manager/0.log" Sep 11 02:19:30.894860 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:30.894830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65646f9664-8xkpm_8cb8bf05-aa7b-4df5-abcf-ef88ed67186b/copy-manifests/0.log" Sep 11 02:19:30.913248 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:30.913214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65646f9664-8xkpm_8cb8bf05-aa7b-4df5-abcf-ef88ed67186b/manager/0.log" Sep 11 02:19:31.272056 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:31.271970 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-db9df5966-6rhrv_740c6579-5390-48d3-9e47-91fae93643fa/maas-api/0.log" Sep 11 02:19:31.493632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:31.493598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-skfc5_ba501ff1-6930-4c62-b76e-8ff3b6b4b098/postgres/0.log" Sep 11 02:19:32.275728 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.275697 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7c787984-782sg_2f3318d4-9740-428d-9a3e-7ee5019020fe/authorino/0.log" Sep 11 02:19:32.395212 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.395184 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7gv58_8f8177cf-83e4-4a12-9947-11b2e04d424e/manager/0.log" Sep 11 02:19:32.521119 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.521091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-49h4m_97c6f31a-ba3f-4402-bd3a-7685af135eba/manager/0.log" Sep 11 02:19:32.634513 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.634488 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-v77dn_f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b/kuadrant-console-plugin/0.log" Sep 11 02:19:32.759098 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.759063 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-h5hhl_ace1cf4b-f345-434b-a908-f59a8b248ec0/manager/0.log" Sep 11 02:19:32.991527 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:32.991442 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-tx6zj_0d454f87-f9e8-4a0d-bd20-1320db62ef6c/manager/0.log" Sep 11 02:19:33.580873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:33.580848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654b967dfc-br4n5_ce3fb496-cc44-46ac-b586-d62d25bf8647/kube-auth-proxy/0.log" Sep 11 02:19:33.811811 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:33.811781 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/1.log" Sep 11 02:19:33.923622 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:33.923533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hk9gs_72b20906-ac5d-45cd-b4c8-3169f1541633/payload-pre-processing/0.log" Sep 11 02:19:34.044468 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:34.044431 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-krz9n_c965bc0a-6ff1-4336-9261-f67e2635af55/payload-processing/0.log" Sep 11 02:19:34.734769 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:34.734738 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-dp8mx_49bf266e-ee7f-4fd2-8e11-34040facbbb6/main/0.log" Sep 11 02:19:36.692055 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:36.692005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:41.354872 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:41.354834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:41.473795 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:41.473745 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" limit=1024 Sep 11 02:19:44.227760 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:44.227717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8vrxg_db0071c5-7ec4-407d-860c-2272d7a8e461/global-pull-secret-syncer/0.log" Sep 11 02:19:44.279054 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:44.279022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m8dz7_520b9582-76ab-4ffe-9a50-508d573b7307/konnectivity-agent/0.log" Sep 11 02:19:44.391880 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:44.391847 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-234.ec2.internal_8aad02c598c34e433b851df1c8655299/haproxy/0.log" Sep 11 02:19:49.151382 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.151346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7c787984-782sg_2f3318d4-9740-428d-9a3e-7ee5019020fe/authorino/0.log" Sep 11 02:19:49.180380 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.180352 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7gv58_8f8177cf-83e4-4a12-9947-11b2e04d424e/manager/0.log" Sep 11 02:19:49.201465 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.201437 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-49h4m_97c6f31a-ba3f-4402-bd3a-7685af135eba/manager/0.log" Sep 11 02:19:49.223609 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.223583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-v77dn_f1bb2477-22c6-4f40-9f8e-cb8ffbb0f61b/kuadrant-console-plugin/0.log" Sep 11 02:19:49.268116 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.268091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-h5hhl_ace1cf4b-f345-434b-a908-f59a8b248ec0/manager/0.log" Sep 11 02:19:49.331620 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:49.331594 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-tx6zj_0d454f87-f9e8-4a0d-bd20-1320db62ef6c/manager/0.log" Sep 11 02:19:50.948443 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:50.948413 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4dt2s_7a4082b6-cb69-4524-8a9b-6ddee59df774/kube-state-metrics/0.log" Sep 11 02:19:50.970558 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:50.970534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4dt2s_7a4082b6-cb69-4524-8a9b-6ddee59df774/kube-rbac-proxy-main/0.log" Sep 11 02:19:50.991858 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:50.991834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4dt2s_7a4082b6-cb69-4524-8a9b-6ddee59df774/kube-rbac-proxy-self/0.log" Sep 11 02:19:51.227657 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:51.227582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcwnx_d9751981-c399-4776-8a6c-9b754f900124/node-exporter/0.log" Sep 11 02:19:51.245962 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:51.245935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcwnx_d9751981-c399-4776-8a6c-9b754f900124/kube-rbac-proxy/0.log" Sep 11 02:19:51.266658 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:51.266636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcwnx_d9751981-c399-4776-8a6c-9b754f900124/init-textfile/0.log" Sep 11 02:19:53.323381 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:53.323296 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-bv2c9_922b8481-0ae5-4736-a017-64809c5c02ba/networking-console-plugin/0.log" Sep 11 02:19:54.445411 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.445356 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f689878-bgsb6_7133fa08-ec04-4296-abf9-ceb962ccda58/console/0.log" Sep 11 02:19:54.497401 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.497363 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4"] Sep 11 02:19:54.500835 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.500818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.502786 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.502769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dlxv\"/\"openshift-service-ca.crt\"" Sep 11 02:19:54.503491 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.503473 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dlxv\"/\"kube-root-ca.crt\"" Sep 11 02:19:54.503491 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.503483 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dlxv\"/\"default-dockercfg-xq759\"" Sep 11 02:19:54.508433 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.508409 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4"] Sep 11 02:19:54.585902 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.585861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-lib-modules\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.586110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.585915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmtk\" (UniqueName: \"kubernetes.io/projected/392c05c3-1cfc-47c1-9833-1057eb829e41-kube-api-access-txmtk\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.586110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.585936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-podres\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.586110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.585974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-sys\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.586110 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.586056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-proc\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687438 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-lib-modules\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmtk\" (UniqueName: \"kubernetes.io/projected/392c05c3-1cfc-47c1-9833-1057eb829e41-kube-api-access-txmtk\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-podres\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-sys\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-proc\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-lib-modules\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687632 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-sys\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687856 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-proc\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.687856 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.687646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/392c05c3-1cfc-47c1-9833-1057eb829e41-podres\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.694517 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.694495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmtk\" (UniqueName: \"kubernetes.io/projected/392c05c3-1cfc-47c1-9833-1057eb829e41-kube-api-access-txmtk\") pod \"perf-node-gather-daemonset-fh8r4\" (UID: \"392c05c3-1cfc-47c1-9833-1057eb829e41\") " pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:54.811903 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:54.811797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:55.080916 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:55.080872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4"] Sep 11 02:19:56.040811 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.040776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" event={"ID":"392c05c3-1cfc-47c1-9833-1057eb829e41","Type":"ContainerStarted","Data":"3e77b2aa2c5acecc12f69b278b9b2a7b1cf969a67a7b8d63721f94f76f30fffb"} Sep 11 02:19:56.041259 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.040836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" event={"ID":"392c05c3-1cfc-47c1-9833-1057eb829e41","Type":"ContainerStarted","Data":"85bd0d2711131aca05ba7db5883517be5cdab4f96be75fd5fcaae9972800d9de"} Sep 11 02:19:56.041259 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.040890 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:19:56.056335 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.056287 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" podStartSLOduration=2.05627143 podStartE2EDuration="2.05627143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:19:56.054253494 +0000 UTC m=+1075.330544086" watchObservedRunningTime="2026-09-11 02:19:56.05627143 +0000 UTC m=+1075.332562023" Sep 11 02:19:56.255659 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.255622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xspsb_331f2a9b-8830-48f9-80da-400d95541e68/dns/0.log" Sep 11 02:19:56.274063 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.274029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xspsb_331f2a9b-8830-48f9-80da-400d95541e68/kube-rbac-proxy/0.log" Sep 11 02:19:56.294711 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.294652 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28wk7_c28c23d5-02c5-4df0-8fcc-765bfcbe1f17/dns-node-resolver/0.log" Sep 11 02:19:56.957614 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:56.957588 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fhs86_10034a0c-3f07-4f9f-8693-5cde30aa7ba6/node-ca/0.log" Sep 11 02:19:57.913225 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:57.913200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654b967dfc-br4n5_ce3fb496-cc44-46ac-b586-d62d25bf8647/kube-auth-proxy/0.log" Sep 11 02:19:57.964215 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:57.964177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/0.log" Sep 11 02:19:57.964431 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:57.964410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/1.log" Sep 11 02:19:57.992461 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:57.992416 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hk9gs_72b20906-ac5d-45cd-b4c8-3169f1541633/payload-pre-processing/0.log" Sep 11 02:19:58.017012 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:58.016971 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-krz9n_c965bc0a-6ff1-4336-9261-f67e2635af55/payload-processing/0.log" Sep 11 02:19:58.661114 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:58.661080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l69lk_388aad7c-68ef-4b0f-84a3-f215d12e6301/serve-healthcheck-canary/0.log" Sep 11 02:19:59.168335 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:59.168305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pncjc_0cdfbc10-5679-4d50-92f5-c06b3ba841be/kube-rbac-proxy/0.log" Sep 11 02:19:59.191578 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:59.191546 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pncjc_0cdfbc10-5679-4d50-92f5-c06b3ba841be/exporter/0.log" Sep 11 02:19:59.211356 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:19:59.211320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pncjc_0cdfbc10-5679-4d50-92f5-c06b3ba841be/extractor/0.log" Sep 11 02:20:01.409730 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:01.409704 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zw4vf_eb0ae041-de38-4ab6-922c-82f75a28fd49/manager/0.log" Sep 11 02:20:01.452081 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:01.452052 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gq95l_c7046489-7e7c-4e21-8c95-b02837101ff9/manager/0.log" Sep 11 02:20:01.489708 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:01.489677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74f949ccff-zxjsl_bcd7f967-f684-40c2-84f4-23bf03c24230/manager/0.log" Sep 11 02:20:01.729411 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:01.729318 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65646f9664-8xkpm_8cb8bf05-aa7b-4df5-abcf-ef88ed67186b/manager/0.log" Sep 11 02:20:01.744477 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:01.744446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65646f9664-8xkpm_8cb8bf05-aa7b-4df5-abcf-ef88ed67186b/copy-manifests/0.log" Sep 11 02:20:02.054423 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:02.054345 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dlxv/perf-node-gather-daemonset-fh8r4" Sep 11 02:20:05.004967 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:05.004931 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654b967dfc-br4n5_ce3fb496-cc44-46ac-b586-d62d25bf8647/kube-auth-proxy/0.log" Sep 11 02:20:05.036409 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:05.036373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/0.log" Sep 11 02:20:05.036635 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:05.036555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/1.log" Sep 11 02:20:05.050204 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:05.050181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hk9gs_72b20906-ac5d-45cd-b4c8-3169f1541633/payload-pre-processing/0.log" Sep 11 02:20:05.069464 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:05.069432 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-krz9n_c965bc0a-6ff1-4336-9261-f67e2635af55/payload-processing/0.log" Sep 11 02:20:06.316591 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:06.316556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654b967dfc-br4n5_ce3fb496-cc44-46ac-b586-d62d25bf8647/kube-auth-proxy/0.log" Sep 11 02:20:06.352754 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:06.352715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/0.log" Sep 11 02:20:06.353009 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:06.352952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-lktvc_8ba12083-4ea3-4a6d-8da5-bba1bb7ff990/istio-proxy/1.log" Sep 11 02:20:06.369580 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:06.369557 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hk9gs_72b20906-ac5d-45cd-b4c8-3169f1541633/payload-pre-processing/0.log" Sep 11 02:20:06.391219 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:06.391192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-krz9n_c965bc0a-6ff1-4336-9261-f67e2635af55/payload-processing/0.log" Sep 11 02:20:09.590024 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.589978 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9t7hm_6df07efe-e751-402d-b58f-4cb3e546de3c/kube-multus/0.log" Sep 11 02:20:09.609976 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.609944 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/kube-multus-additional-cni-plugins/0.log" Sep 11 02:20:09.628743 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.628710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/egress-router-binary-copy/0.log" Sep 11 02:20:09.647873 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.647841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/cni-plugins/0.log" Sep 11 02:20:09.667124 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.667099 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/bond-cni-plugin/0.log" Sep 11 02:20:09.684886 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.684859 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/routeoverride-cni/0.log" Sep 11 02:20:09.702618 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.702595 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/whereabouts-cni-bincopy/0.log" Sep 11 02:20:09.720576 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:09.720553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n9r9k_ef36f517-4baf-4369-bb25-1c7cd86cf177/whereabouts-cni/0.log" Sep 11 02:20:10.131823 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:10.131792 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mtjkg_95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51/network-metrics-daemon/0.log" Sep 11 02:20:10.150431 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:10.150405 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mtjkg_95ffa4b1-80d3-4ff0-92b2-bdbb670dcd51/kube-rbac-proxy/0.log" Sep 11 02:20:11.358723 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.358686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/ovn-controller/0.log" Sep 11 02:20:11.375307 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.375278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/ovn-acl-logging/0.log" Sep 11 02:20:11.396210 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.396181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/kube-rbac-proxy-node/0.log" Sep 11 02:20:11.425248 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.425210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 02:20:11.447609 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.447565 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/northd/0.log" Sep 11 02:20:11.466742 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.466719 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/nbdb/0.log" Sep 11 02:20:11.486101 ip-10-0-135-234 kubenswrapper[2581]: I0911 02:20:11.486073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbmv_2eb436f4-fe67-4f6e-a922-5249b835f447/sbdb/0.log"