Sep 08 13:14:42.971606 ip-10-0-142-86 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 08 13:14:42.971622 ip-10-0-142-86 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 08 13:14:42.971632 ip-10-0-142-86 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 08 13:14:42.971873 ip-10-0-142-86 systemd[1]: Failed to start Kubernetes Kubelet. Sep 08 13:14:53.104864 ip-10-0-142-86 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 08 13:14:53.104883 ip-10-0-142-86 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d438f898ac8f4a61b547d0ac4f28d36f -- Sep 08 13:17:01.682314 ip-10-0-142-86 systemd[1]: Starting Kubernetes Kubelet... Sep 08 13:17:02.043272 ip-10-0-142-86 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:17:02.043272 ip-10-0-142-86 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 13:17:02.043272 ip-10-0-142-86 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:17:02.043272 ip-10-0-142-86 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 13:17:02.043272 ip-10-0-142-86 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 13:17:02.045688 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.045581 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 13:17:02.048831 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048802 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.048831 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048827 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.048831 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048832 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048835 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048840 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048843 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048846 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048849 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048851 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048854 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048857 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048861 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048864 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048866 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048869 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048872 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048876 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048879 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048882 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048884 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048888 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.048956 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048890 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048893 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048896 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048898 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048901 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048904 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048906 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048927 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048930 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048933 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048936 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048939 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048941 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048944 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048947 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048950 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048953 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048957 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048959 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.049417 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048962 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048965 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048975 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048979 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048981 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048984 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048987 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048990 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048993 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048996 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.048998 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049001 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049004 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049007 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049010 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049013 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049018 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049023 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049026 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049029 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.049954 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049032 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049035 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049039 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049042 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049045 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049048 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049051 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049055 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049058 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049062 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049065 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049068 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049073 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049075 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049078 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049087 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049090 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049094 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049099 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049102 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.050544 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049105 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049107 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049110 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049113 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049116 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049119 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049121 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049124 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049127 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049130 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049133 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049135 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049138 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049141 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049149 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049152 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049155 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049158 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049902 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.051071 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049927 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049931 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049934 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049936 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049940 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049943 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049946 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049949 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049952 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049955 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049958 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049961 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049964 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049967 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049970 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049973 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049976 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049978 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049981 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049984 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.051583 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049987 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049990 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049992 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049995 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.049997 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050000 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050003 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050005 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050008 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050011 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050014 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050019 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050023 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050026 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050029 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050032 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050035 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050038 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050041 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.052120 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050044 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050047 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050050 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050053 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050056 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050058 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050061 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050064 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050066 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050069 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050071 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050074 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050077 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050079 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050082 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050085 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050087 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050090 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050092 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050096 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.052579 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050099 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050101 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050104 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050106 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050110 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050113 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050116 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050119 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050122 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050125 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050128 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050130 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050135 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050138 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050141 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050144 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050147 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050150 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050154 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.053093 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050157 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050160 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050163 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050166 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050169 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050172 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050174 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050177 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050182 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050184 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050187 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050190 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050193 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050196 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050199 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050201 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050205 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050207 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050210 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.053575 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050632 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050639 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050642 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050644 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050647 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050650 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050653 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050656 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050659 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050662 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050665 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050668 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050670 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050673 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050675 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050678 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050681 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050684 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050687 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050689 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.054127 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050692 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050695 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050697 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050701 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050704 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050706 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050709 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050712 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050715 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050718 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050721 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050724 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050727 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050729 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050732 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050735 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050738 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050740 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050743 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.054620 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050745 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050749 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050754 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050757 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050761 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050763 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050766 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050769 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050771 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050774 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050776 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050778 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050781 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050784 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050787 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050789 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050792 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050794 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050798 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.055118 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050801 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050803 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050806 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050809 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050811 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050814 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050817 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050820 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050822 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050824 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050827 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050830 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050833 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050836 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050839 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050841 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050844 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050847 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050850 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050852 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.055626 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050855 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050857 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050860 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050863 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050866 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050868 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050871 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050874 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050878 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050882 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050885 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050887 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050890 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050893 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050896 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050900 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050904 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050907 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050924 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.056150 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050928 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.050931 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051021 2576 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051072 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051079 2576 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051085 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051091 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051095 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051100 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051105 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051109 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051113 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051116 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051120 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051123 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051126 2576 flags.go:64] FLAG: --cgroup-root="" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051129 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051132 2576 flags.go:64] FLAG: --client-ca-file="" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051135 2576 flags.go:64] FLAG: --cloud-provider="external" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051138 2576 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051145 2576 flags.go:64] FLAG: --cluster-domain="" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051148 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051151 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051154 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 13:17:02.056641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051158 2576 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051162 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051165 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051169 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051172 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051176 2576 flags.go:64] FLAG: --contention-profiling="false" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051179 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051182 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051186 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051188 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051193 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051196 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051199 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051202 2576 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051205 2576 flags.go:64] FLAG: --enable-server="true" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051208 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051213 2576 flags.go:64] FLAG: --event-burst="100" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051216 2576 flags.go:64] FLAG: --event-qps="50" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051219 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051223 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051226 2576 flags.go:64] FLAG: --eviction-hard="" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051230 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051233 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051237 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051240 2576 flags.go:64] FLAG: --eviction-soft="" Sep 08 13:17:02.057295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051243 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051246 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051249 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051252 2576 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051255 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051258 2576 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051261 2576 flags.go:64] FLAG: --feature-gates="" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051265 2576 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051271 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051275 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051278 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051281 2576 flags.go:64] FLAG: --healthz-port="10248" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051285 2576 flags.go:64] FLAG: --help="false" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051288 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051291 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051294 2576 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051297 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051301 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051304 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051307 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051311 2576 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051314 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051317 2576 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 13:17:02.057896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051321 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051324 2576 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051327 2576 flags.go:64] FLAG: --kube-reserved="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051330 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051333 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051337 2576 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051342 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051345 2576 flags.go:64] FLAG: --lock-file="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051348 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051351 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051354 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051361 2576 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051364 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051367 2576 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051370 2576 flags.go:64] FLAG: --logging-format="text" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051373 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051377 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051383 2576 flags.go:64] FLAG: --manifest-url="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051386 2576 flags.go:64] FLAG: --manifest-url-header="" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051391 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051394 2576 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051398 2576 flags.go:64] FLAG: --max-pods="110" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051401 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051404 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051408 2576 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 13:17:02.058524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051411 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051414 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051417 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051420 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051429 2576 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051433 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051436 2576 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051439 2576 flags.go:64] FLAG: --pod-cidr="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051443 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051449 2576 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051452 2576 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051455 2576 flags.go:64] FLAG: --pods-per-core="0" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051459 2576 flags.go:64] FLAG: --port="10250" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051463 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051468 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd82df19ac10b001" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051472 2576 flags.go:64] FLAG: --qos-reserved="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051475 2576 flags.go:64] FLAG: --read-only-port="10255" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051478 2576 flags.go:64] FLAG: --register-node="true" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051481 2576 flags.go:64] FLAG: --register-with-taints="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051485 2576 flags.go:64] FLAG: --registry-burst="10" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051488 2576 flags.go:64] FLAG: --registry-qps="5" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051491 2576 flags.go:64] FLAG: --reserved-cpus="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051494 2576 flags.go:64] FLAG: --reserved-memory="" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051498 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051502 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 13:17:02.059224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051505 2576 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051508 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051511 2576 flags.go:64] FLAG: --runonce="false" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051514 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051517 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051521 2576 flags.go:64] FLAG: --seccomp-default="false" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051524 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051527 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051530 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051533 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051537 2576 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051540 2576 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051543 2576 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051546 2576 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051549 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051552 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051555 2576 flags.go:64] FLAG: --system-cgroups="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051558 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051563 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051566 2576 flags.go:64] FLAG: --tls-cert-file="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051570 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051577 2576 flags.go:64] FLAG: --tls-min-version="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051580 2576 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051583 2576 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051586 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 13:17:02.059862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051589 2576 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051593 2576 flags.go:64] FLAG: --v="2" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051597 2576 flags.go:64] FLAG: --version="false" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051602 2576 flags.go:64] FLAG: --vmodule="" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051606 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.051609 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051747 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051751 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051754 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051757 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051760 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051763 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051766 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051768 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051771 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051774 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051778 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051780 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051783 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051786 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051789 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.060557 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051792 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051794 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051797 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051799 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051802 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051807 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051810 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051816 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051819 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051822 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051824 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051827 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051830 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051833 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051836 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051839 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051841 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051845 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051848 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051851 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.061114 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051853 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051856 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051859 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051862 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051864 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051867 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051870 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051873 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051875 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051877 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051880 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051883 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051885 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051888 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051891 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051893 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051896 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051899 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051901 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051905 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.061617 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051921 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051925 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051928 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051931 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051933 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051936 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051939 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051943 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051947 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051952 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051955 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051959 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051961 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051964 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051968 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051970 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051973 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051976 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051979 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051981 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.062136 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051984 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051987 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051989 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051992 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051995 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.051999 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052002 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052005 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052008 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052011 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052014 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052019 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052022 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052025 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052028 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052031 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052034 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052037 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052039 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.062638 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052042 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052045 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052049 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052052 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.052055 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.052808 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.060430 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.060452 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.061126 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.061134 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061199 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061207 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061210 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061214 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061218 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.063119 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061221 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061224 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061227 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061230 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061233 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061235 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061238 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061241 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061244 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061246 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061250 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061253 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061256 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061259 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061261 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061264 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061266 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061269 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061272 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061275 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061278 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.063507 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061281 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061284 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061286 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061291 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061295 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061298 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061301 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061304 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061307 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061309 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061312 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061315 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061318 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061320 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061323 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061325 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061328 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061331 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061333 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061336 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.064103 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061339 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061342 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061345 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061348 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061351 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061354 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061356 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061359 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061361 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061364 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061367 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061369 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061372 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061374 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061377 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061379 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061382 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061386 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061390 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.064640 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061393 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061396 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061400 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061403 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061405 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061408 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061411 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061414 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061416 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061419 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061421 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061424 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061427 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061430 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061432 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061435 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061438 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061441 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061444 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.065139 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061446 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061449 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061452 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061455 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061458 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061460 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061463 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061466 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061468 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061470 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061473 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061476 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061479 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061481 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061484 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.065733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.061490 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061612 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061619 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061622 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061625 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061629 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061631 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061634 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061637 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061643 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061646 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061648 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061651 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061654 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061660 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061663 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061665 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061668 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 13:17:02.066148 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061671 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061674 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061677 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061680 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061683 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061687 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061689 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061692 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061695 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061698 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061701 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061704 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061706 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061709 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061711 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061714 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061717 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061719 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061722 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061725 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 13:17:02.066739 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061727 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061730 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061732 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061735 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061738 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061741 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061743 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061746 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061749 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061751 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061754 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061757 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061760 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061763 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061765 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061768 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061771 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061774 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061776 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061779 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 13:17:02.067284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061781 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061784 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061787 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061790 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061793 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061796 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061798 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061801 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061804 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061806 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061809 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061811 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061814 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061817 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061819 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061822 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061825 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061828 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061830 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 13:17:02.067801 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061833 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061836 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061838 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061842 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061845 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061849 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061853 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061857 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061860 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061863 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061867 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061869 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061872 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061874 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061877 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061880 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061883 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061886 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 13:17:02.068480 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061891 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:02.061894 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.061899 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.062057 2576 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.064438 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.065232 2576 server.go:1019] "Starting client certificate rotation" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.065350 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.065410 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.067672 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 13:17:02.069009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.068851 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 13:17:02.079219 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.079189 2576 log.go:25] "Validated CRI v1 runtime API" Sep 08 13:17:02.083184 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.083164 2576 log.go:25] "Validated CRI v1 image API" Sep 08 13:17:02.084141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.084121 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 13:17:02.087042 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.087011 2576 fs.go:135] Filesystem UUIDs: map[10487eff-f391-417a-afb4-afd8525f306c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9351d3ff-76eb-4b34-98d5-4fccd87662f9:/dev/nvme0n1p4] Sep 08 13:17:02.087186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.087037 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 13:17:02.092695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.092537 2576 manager.go:216] Machine: {Timestamp:2026-09-08 13:17:02.092000342 +0000 UTC m=+0.299658449 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100811 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2319225bfabf89704da261ca3049f5 SystemUUID:ec231922-5bfa-bf89-704d-a261ca3049f5 BootID:d438f898-ac8f-4a61-b547-d0ac4f28d36f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:b0:bf:87:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:b0:bf:87:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:da:00:69:a8:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 13:17:02.092695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.092661 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 13:17:02.092899 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.092798 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 13:17:02.096537 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.096493 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 13:17:02.096688 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.096537 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 13:17:02.097174 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.097157 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 13:17:02.097711 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.097696 2576 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 13:17:02.097743 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.097714 2576 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 13:17:02.097743 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.097723 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 13:17:02.098379 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.098366 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 13:17:02.100003 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.099984 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 13:17:02.103886 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.103866 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 08 13:17:02.104054 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104043 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 13:17:02.104097 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104076 2576 kubelet.go:486] "Attempting to sync node with API server" Sep 08 13:17:02.104097 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104086 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 13:17:02.104097 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104098 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 13:17:02.104203 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104108 2576 kubelet.go:398] "Adding apiserver pod source" Sep 08 13:17:02.104203 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104119 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 13:17:02.104586 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104571 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 13:17:02.104735 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.104598 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 13:17:02.107018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.106997 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 13:17:02.109618 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109595 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 13:17:02.109684 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109645 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109853 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109867 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109874 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109880 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109888 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 13:17:02.109895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.109895 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 13:17:02.110380 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110370 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 13:17:02.110380 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110380 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 13:17:02.110439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110387 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 13:17:02.110439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110393 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 13:17:02.110439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110402 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 13:17:02.110439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.110413 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 13:17:02.111177 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.111165 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 13:17:02.111177 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.111179 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 13:17:02.113160 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.113121 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 13:17:02.113614 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.113189 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 13:17:02.114843 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.114818 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 13:17:02.116053 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.116030 2576 server.go:1268] "Started kubelet" Sep 08 13:17:02.116200 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.116121 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 13:17:02.116259 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.116157 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 13:17:02.116259 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.116242 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 13:17:02.117126 ip-10-0-142-86 systemd[1]: Started Kubernetes Kubelet. Sep 08 13:17:02.117668 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.117651 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 13:17:02.119841 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.119105 2576 server.go:310] "Adding debug handlers to kubelet server" Sep 08 13:17:02.121290 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.121266 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 13:17:02.122125 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.121242 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-86.ec2.internal.18d35ae6495c6567 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-86.ec2.internal,UID:ip-10-0-142-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-86.ec2.internal,},FirstTimestamp:2026-09-08 13:17:02.115988839 +0000 UTC m=+0.323646928,LastTimestamp:2026-09-08 13:17:02.115988839 +0000 UTC m=+0.323646928,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-86.ec2.internal,}" Sep 08 13:17:02.123332 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.123318 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 13:17:02.123890 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.123873 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 13:17:02.124038 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.123979 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.124399 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.124352 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 13:17:02.124399 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.124400 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 13:17:02.124541 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.124355 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 13:17:02.124541 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.124501 2576 reconstruct.go:97] "Volume reconstruction finished" Sep 08 13:17:02.124541 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.124511 2576 reconciler.go:29] "Reconciler: start to sync state" Sep 08 13:17:02.125023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125003 2576 factory.go:55] Registering systemd factory Sep 08 13:17:02.125023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125025 2576 factory.go:223] Registration of the systemd container factory successfully Sep 08 13:17:02.125275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125258 2576 factory.go:153] Registering CRI-O factory Sep 08 13:17:02.125275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125275 2576 factory.go:223] Registration of the crio container factory successfully Sep 08 13:17:02.125390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125333 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 13:17:02.125390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125353 2576 factory.go:103] Registering Raw factory Sep 08 13:17:02.125390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125366 2576 manager.go:1196] Started watching for new ooms in manager Sep 08 13:17:02.125826 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.125813 2576 manager.go:349] Starting recovery of all containers Sep 08 13:17:02.127322 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.127287 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 13:17:02.127531 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.127512 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 13:17:02.140538 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.139069 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v85c4" Sep 08 13:17:02.140538 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.139763 2576 manager.go:354] Recovery completed Sep 08 13:17:02.147031 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.147000 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v85c4" Sep 08 13:17:02.148027 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.148011 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.150183 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150158 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.150312 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150193 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.150312 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150204 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.150829 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150815 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 13:17:02.150829 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150826 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.150829 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150828 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 13:17:02.150992 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.150846 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 08 13:17:02.151596 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.151580 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.151658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.151613 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.151658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.151626 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.152088 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.152073 2576 policy_none.go:49] "None policy: Start" Sep 08 13:17:02.152140 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.152094 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 13:17:02.152140 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.152105 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 13:17:02.152472 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.152396 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-86.ec2.internal.18d35ae64b661864 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-86.ec2.internal,UID:ip-10-0-142-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-86.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-86.ec2.internal,},FirstTimestamp:2026-09-08 13:17:02.150178916 +0000 UTC m=+0.357837003,LastTimestamp:2026-09-08 13:17:02.150178916 +0000 UTC m=+0.357837003,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-86.ec2.internal,}" Sep 08 13:17:02.154035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.154022 2576 policy_none.go:47] "Start" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.191934 2576 manager.go:337] "Starting Device Plugin manager" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.191984 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.191996 2576 server.go:87] "Starting device plugin registration server" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.192361 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.192372 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.192484 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.192570 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.192579 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.193284 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 13:17:02.241499 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.193337 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.267814 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.267774 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 13:17:02.269012 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.268987 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 13:17:02.269090 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.269066 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 13:17:02.269135 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.269114 2576 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 13:17:02.269243 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.269227 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 13:17:02.271612 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.271590 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:17:02.293570 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.293476 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.294934 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.294867 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.295070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.294950 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.295070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.294969 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.295070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.295020 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.303934 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.303894 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.304101 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.303959 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-86.ec2.internal\": node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.325150 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.325121 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.370314 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.370277 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal"] Sep 08 13:17:02.370438 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.370363 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.371599 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.371582 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.371691 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.371612 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.371691 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.371621 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.373018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373004 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.373156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.373212 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373175 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.373832 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373814 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.373832 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373823 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.374009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373841 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.374009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373846 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.374009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373852 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.374009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.373859 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.375173 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.375156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.375257 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.375190 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 13:17:02.376009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.375992 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientMemory" Sep 08 13:17:02.376093 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.376026 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 13:17:02.376093 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.376038 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeHasSufficientPID" Sep 08 13:17:02.403017 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.402985 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-86.ec2.internal\" not found" node="ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.407969 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.407945 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-86.ec2.internal\" not found" node="ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.426169 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.426132 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.525855 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.525813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.526000 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.525862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.526000 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.525907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc722220b0bff438767064ce86b64eb2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-86.ec2.internal\" (UID: \"fc722220b0bff438767064ce86b64eb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.526848 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.526828 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.626858 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc722220b0bff438767064ce86b64eb2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-86.ec2.internal\" (UID: \"fc722220b0bff438767064ce86b64eb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.626858 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.627046 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.626871 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.627046 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc722220b0bff438767064ce86b64eb2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-86.ec2.internal\" (UID: \"fc722220b0bff438767064ce86b64eb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.627046 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.627046 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.627046 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.626985 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/785ef9eb1aa6b96c391200ecd99bd0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal\" (UID: \"785ef9eb1aa6b96c391200ecd99bd0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.706045 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.706006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.712090 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:02.712071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:02.727614 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.727586 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.828057 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.828002 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:02.928467 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:02.928392 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:03.028885 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:03.028831 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:03.066077 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.066043 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 13:17:03.066646 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.066210 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 13:17:03.087198 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.087166 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:17:03.129453 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:03.129423 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:03.150148 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.150101 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 13:12:02 +0000 UTC" deadline="2028-03-10 14:33:32.645322181 +0000 UTC" Sep 08 13:17:03.150249 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.150159 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13177h16m29.495167855s" Sep 08 13:17:03.229690 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:03.229621 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:03.284131 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.284098 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:17:03.330461 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:03.330436 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-86.ec2.internal\" not found" Sep 08 13:17:03.379452 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.379429 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:17:03.424519 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.424489 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" Sep 08 13:17:03.434516 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.434490 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 13:17:03.435400 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.435384 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" Sep 08 13:17:03.447564 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.447537 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 13:17:03.618884 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:03.618854 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc722220b0bff438767064ce86b64eb2.slice/crio-79f3a3a88b827e198163f2770f907015bb362575ab02adf7d21b7b7475409d00 WatchSource:0}: Error finding container 79f3a3a88b827e198163f2770f907015bb362575ab02adf7d21b7b7475409d00: Status 404 returned error can't find the container with id 79f3a3a88b827e198163f2770f907015bb362575ab02adf7d21b7b7475409d00 Sep 08 13:17:03.623163 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:03.623146 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 13:17:04.105136 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.105032 2576 apiserver.go:52] "Watching apiserver" Sep 08 13:17:04.114116 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.114084 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 13:17:04.115454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.115430 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4rndf","openshift-multus/multus-additional-cni-plugins-lgq2l","openshift-ovn-kubernetes/ovnkube-node-cvm89","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn","openshift-dns/node-resolver-lxnqs","openshift-image-registry/node-ca-bjht9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal","openshift-multus/network-metrics-daemon-b4sft","openshift-network-diagnostics/network-check-target-vxxgm","openshift-network-operator/iptables-alerter-khjgp","kube-system/global-pull-secret-syncer-rfk4c","kube-system/konnectivity-agent-58hdt","kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lftlm"] Sep 08 13:17:04.117476 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.117448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.118676 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.118654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.120111 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120096 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 13:17:04.120549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.120549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120427 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 13:17:04.120549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vvd4m\"" Sep 08 13:17:04.120549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.120549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.120470 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.120895 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.120585 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:04.121020 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.121003 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.121150 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.121037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7kqxw\"" Sep 08 13:17:04.121345 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.121329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.121742 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.121724 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.122793 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.122775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.123856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.123836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.124217 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.124195 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 13:17:04.124448 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.124238 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 13:17:04.124448 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.124244 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.124448 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.124279 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.124448 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.124388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qng6\"" Sep 08 13:17:04.125219 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.125199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.125311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.125208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.125311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.125272 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.125311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.125303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vwvxm\"" Sep 08 13:17:04.126057 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.126042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zw9kn\"" Sep 08 13:17:04.126402 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.126385 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.126470 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.126458 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 13:17:04.126546 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.126531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:04.126618 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.126597 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:04.127849 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.127826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.127976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.127853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.128045 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.128031 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.128623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.128821 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.129069 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6svj4\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.129468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.129618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.129838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.129658 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.131029 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.131007 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sdzsd\"" Sep 08 13:17:04.131252 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.131229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:17:04.131252 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.131247 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 13:17:04.131411 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.131090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 13:17:04.132476 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.132601 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.132573 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:04.132814 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-multus\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.132876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-cnibin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.132876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-run\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.132876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.133023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.133023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-kubelet\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.132983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs6nz\" (UniqueName: \"kubernetes.io/projected/a788c6c8-4df9-4e8b-92b5-739e9d54723f-kube-api-access-qs6nz\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.133023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-modprobe-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6vt\" (UniqueName: \"kubernetes.io/projected/64e8eca3-fd82-42d5-8969-1f100287f790-kube-api-access-tc6vt\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-slash\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-log-socket\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-bin\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-hostroot\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-env-overrides\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/263e761f-f62d-4a21-a3fc-ae988ab70137-ovn-node-metrics-cert\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e8eca3-fd82-42d5-8969-1f100287f790-tmp-dir\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysconfig\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-kubernetes\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-systemd\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-sys\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k57zm\" (UniqueName: \"kubernetes.io/projected/9166ddbf-c8df-4a71-af63-48d1a617df9d-kube-api-access-k57zm\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-systemd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-script-lib\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-serviceca\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.133558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-ovn\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-conf\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-host\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-kubelet\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-conf-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-multus-certs\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-bin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-lib-modules\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-var-lib-kubelet\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8r97\" (UniqueName: \"kubernetes.io/projected/263e761f-f62d-4a21-a3fc-ae988ab70137-kube-api-access-c8r97\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-netd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-socket-dir-parent\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-device-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-node-log\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134186 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.133978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-netns\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-config\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-k8s-cni-cncf-io\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxn49\" (UniqueName: \"kubernetes.io/projected/36c6c87a-d2f6-4661-bee2-a959a52e0780-kube-api-access-sxn49\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64e8eca3-fd82-42d5-8969-1f100287f790-hosts-file\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-kube-api-access-g8bcr\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-host\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-tuned\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-systemd-units\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-var-lib-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-etc-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-system-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-etc-kubernetes\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-netns\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-daemon-config\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44xj4\" (UniqueName: \"kubernetes.io/projected/b47451f9-07f2-4c1a-a703-25a40da89a5a-kube-api-access-44xj4\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.134762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.135301 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-tmp\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.135301 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.134576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-cni-binary-copy\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.135432 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.135417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.136013 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.135982 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 13:17:04.136423 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.136408 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x55z2\"" Sep 08 13:17:04.136645 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.136628 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 13:17:04.136736 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.136678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 13:17:04.137899 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.137877 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 13:17:04.137998 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.137881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6ggnj\"" Sep 08 13:17:04.138224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.138205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 13:17:04.162122 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.162097 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68pcw" Sep 08 13:17:04.170284 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.170259 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68pcw" Sep 08 13:17:04.226399 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.226365 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 13:17:04.234801 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-bin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.234890 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.234890 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-lib-modules\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.234890 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-var-lib-kubelet\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234879 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-bin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8r97\" (UniqueName: \"kubernetes.io/projected/263e761f-f62d-4a21-a3fc-ae988ab70137-kube-api-access-c8r97\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.234985 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-var-lib-kubelet\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-kubelet-config\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-lib-modules\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235036 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.235075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-netd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-socket-dir-parent\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-device-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-netd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-node-log\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-netns\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235161 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-node-log\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-socket-dir-parent\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-netns\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rn8s\" (UniqueName: \"kubernetes.io/projected/c3933738-fa0b-4671-8b62-c94a32826690-kube-api-access-4rn8s\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-config\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-k8s-cni-cncf-io\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235271 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-device-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-k8s-cni-cncf-io\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxn49\" (UniqueName: \"kubernetes.io/projected/36c6c87a-d2f6-4661-bee2-a959a52e0780-kube-api-access-sxn49\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64e8eca3-fd82-42d5-8969-1f100287f790-hosts-file\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-kube-api-access-g8bcr\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.235454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-host\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-tuned\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64e8eca3-fd82-42d5-8969-1f100287f790-hosts-file\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-systemd-units\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-systemd-units\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-var-lib-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-etc-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-var-lib-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-host\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-system-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-etc-kubernetes\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-etc-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-etc-kubernetes\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-netns\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-daemon-config\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235767 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-netns\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44xj4\" (UniqueName: \"kubernetes.io/projected/b47451f9-07f2-4c1a-a703-25a40da89a5a-kube-api-access-44xj4\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.236326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-system-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-tmp\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-cni-binary-copy\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.235976 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-config\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-multus\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-cnibin\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3933738-fa0b-4671-8b62-c94a32826690-host-slash\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9drmp\" (UniqueName: \"kubernetes.io/projected/2447a82f-ab9b-433e-9153-4c68c150b36a-kube-api-access-9drmp\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236198 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-cni-multus\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-cnibin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3933738-fa0b-4671-8b62-c94a32826690-iptables-alerter-script\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-run\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-cnibin\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-kubelet\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.237172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs6nz\" (UniqueName: \"kubernetes.io/projected/a788c6c8-4df9-4e8b-92b5-739e9d54723f-kube-api-access-qs6nz\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236369 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.236376 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236412 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-run\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0d397dd-0678-41ca-9131-56ea93caac19-agent-certs\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236449 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-kubelet\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.236463 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:04.736425961 +0000 UTC m=+2.944084050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0d397dd-0678-41ca-9131-56ea93caac19-konnectivity-ca\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236549 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-modprobe-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6vt\" (UniqueName: \"kubernetes.io/projected/64e8eca3-fd82-42d5-8969-1f100287f790-kube-api-access-tc6vt\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-slash\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236655 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-modprobe-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-log-socket\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-bin\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-hostroot\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-dbus\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236779 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-log-socket\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-slash\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-cni-bin\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-hostroot\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236861 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-openvswitch\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236871 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.236990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-env-overrides\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/263e761f-f62d-4a21-a3fc-ae988ab70137-ovn-node-metrics-cert\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e8eca3-fd82-42d5-8969-1f100287f790-tmp-dir\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysconfig\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-kubernetes\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-systemd\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.238765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-sys\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-daemon-config\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k57zm\" (UniqueName: \"kubernetes.io/projected/9166ddbf-c8df-4a71-af63-48d1a617df9d-kube-api-access-k57zm\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b47451f9-07f2-4c1a-a703-25a40da89a5a-cni-binary-copy\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-systemd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-script-lib\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-systemd\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysconfig\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-kubernetes\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-systemd\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-sys\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-serviceca\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-ovn\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/263e761f-f62d-4a21-a3fc-ae988ab70137-run-ovn\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-cni-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-ovnkube-script-lib\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-conf\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-host\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-kubelet\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-d\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-conf-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-host\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-multus-certs\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-var-lib-kubelet\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-serviceca\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-multus-conf-dir\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b47451f9-07f2-4c1a-a703-25a40da89a5a-host-run-multus-certs\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.239902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.237988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-system-cni-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.238019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.238006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-sysctl-conf\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.238099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9166ddbf-c8df-4a71-af63-48d1a617df9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.238105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/263e761f-f62d-4a21-a3fc-ae988ab70137-env-overrides\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.238218 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e8eca3-fd82-42d5-8969-1f100287f790-tmp-dir\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.240304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-etc-tuned\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.240325 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.240356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c6c87a-d2f6-4661-bee2-a959a52e0780-tmp\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.240635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.240564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/263e761f-f62d-4a21-a3fc-ae988ab70137-ovn-node-metrics-cert\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.244241 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.244211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44xj4\" (UniqueName: \"kubernetes.io/projected/b47451f9-07f2-4c1a-a703-25a40da89a5a-kube-api-access-44xj4\") pod \"multus-4rndf\" (UID: \"b47451f9-07f2-4c1a-a703-25a40da89a5a\") " pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.247641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.247601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxn49\" (UniqueName: \"kubernetes.io/projected/36c6c87a-d2f6-4661-bee2-a959a52e0780-kube-api-access-sxn49\") pod \"tuned-lftlm\" (UID: \"36c6c87a-d2f6-4661-bee2-a959a52e0780\") " pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.247893 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.247874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs6nz\" (UniqueName: \"kubernetes.io/projected/a788c6c8-4df9-4e8b-92b5-739e9d54723f-kube-api-access-qs6nz\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.248333 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.248313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/1c56b6bb-eb24-48b2-8951-b3cb14b77bdc-kube-api-access-g8bcr\") pod \"node-ca-bjht9\" (UID: \"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc\") " pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.248461 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.248443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8r97\" (UniqueName: \"kubernetes.io/projected/263e761f-f62d-4a21-a3fc-ae988ab70137-kube-api-access-c8r97\") pod \"ovnkube-node-cvm89\" (UID: \"263e761f-f62d-4a21-a3fc-ae988ab70137\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.248494 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.248466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k57zm\" (UniqueName: \"kubernetes.io/projected/9166ddbf-c8df-4a71-af63-48d1a617df9d-kube-api-access-k57zm\") pod \"aws-ebs-csi-driver-node-9kphn\" (UID: \"9166ddbf-c8df-4a71-af63-48d1a617df9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.248872 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.248851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6vt\" (UniqueName: \"kubernetes.io/projected/64e8eca3-fd82-42d5-8969-1f100287f790-kube-api-access-tc6vt\") pod \"node-resolver-lxnqs\" (UID: \"64e8eca3-fd82-42d5-8969-1f100287f790\") " pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.273709 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.273655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" event={"ID":"fc722220b0bff438767064ce86b64eb2","Type":"ContainerStarted","Data":"79f3a3a88b827e198163f2770f907015bb362575ab02adf7d21b7b7475409d00"} Sep 08 13:17:04.339075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9drmp\" (UniqueName: \"kubernetes.io/projected/2447a82f-ab9b-433e-9153-4c68c150b36a-kube-api-access-9drmp\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3933738-fa0b-4671-8b62-c94a32826690-iptables-alerter-script\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.339330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0d397dd-0678-41ca-9131-56ea93caac19-agent-certs\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.339330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0d397dd-0678-41ca-9131-56ea93caac19-konnectivity-ca\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.339330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-dbus\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-system-cni-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339433 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-dbus\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339521 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.339514 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-kubelet-config\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-system-cni-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.339574 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:04.839554109 +0000 UTC m=+3.047212196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-kubelet-config\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rn8s\" (UniqueName: \"kubernetes.io/projected/c3933738-fa0b-4671-8b62-c94a32826690-kube-api-access-4rn8s\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-cnibin\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3933738-fa0b-4671-8b62-c94a32826690-host-slash\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3933738-fa0b-4671-8b62-c94a32826690-host-slash\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.339847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-cnibin\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3933738-fa0b-4671-8b62-c94a32826690-iptables-alerter-script\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0d397dd-0678-41ca-9131-56ea93caac19-konnectivity-ca\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.339900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.340112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2447a82f-ab9b-433e-9153-4c68c150b36a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.340117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.340279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.340196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2447a82f-ab9b-433e-9153-4c68c150b36a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.341934 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.341900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0d397dd-0678-41ca-9131-56ea93caac19-agent-certs\") pod \"konnectivity-agent-58hdt\" (UID: \"c0d397dd-0678-41ca-9131-56ea93caac19\") " pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.345789 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.345764 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:04.345789 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.345789 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:04.345964 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.345802 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:04.345964 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.345870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:04.84585248 +0000 UTC m=+3.053510570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:04.347434 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.347411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9drmp\" (UniqueName: \"kubernetes.io/projected/2447a82f-ab9b-433e-9153-4c68c150b36a-kube-api-access-9drmp\") pod \"multus-additional-cni-plugins-lgq2l\" (UID: \"2447a82f-ab9b-433e-9153-4c68c150b36a\") " pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.348156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.348137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rn8s\" (UniqueName: \"kubernetes.io/projected/c3933738-fa0b-4671-8b62-c94a32826690-kube-api-access-4rn8s\") pod \"iptables-alerter-khjgp\" (UID: \"c3933738-fa0b-4671-8b62-c94a32826690\") " pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.428207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.428120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4rndf" Sep 08 13:17:04.437034 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.437005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lftlm" Sep 08 13:17:04.437291 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.437265 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47451f9_07f2_4c1a_a703_25a40da89a5a.slice/crio-90b72d6f43760d97c4e7f0c21c0f4ae4c5045cfe27f12da794e3d5976f8d2f76 WatchSource:0}: Error finding container 90b72d6f43760d97c4e7f0c21c0f4ae4c5045cfe27f12da794e3d5976f8d2f76: Status 404 returned error can't find the container with id 90b72d6f43760d97c4e7f0c21c0f4ae4c5045cfe27f12da794e3d5976f8d2f76 Sep 08 13:17:04.444668 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.444629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" Sep 08 13:17:04.445074 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.445051 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c6c87a_d2f6_4661_bee2_a959a52e0780.slice/crio-6046e79eb0842c620db43c3d93c8b62c77242eb3b20475191471dd2780777a38 WatchSource:0}: Error finding container 6046e79eb0842c620db43c3d93c8b62c77242eb3b20475191471dd2780777a38: Status 404 returned error can't find the container with id 6046e79eb0842c620db43c3d93c8b62c77242eb3b20475191471dd2780777a38 Sep 08 13:17:04.449434 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.449412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxnqs" Sep 08 13:17:04.452779 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.452755 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9166ddbf_c8df_4a71_af63_48d1a617df9d.slice/crio-8d45f185f8a4af874ecb94007c48e34fe047fa55b2b59d0fca3482c3c7c838e4 WatchSource:0}: Error finding container 8d45f185f8a4af874ecb94007c48e34fe047fa55b2b59d0fca3482c3c7c838e4: Status 404 returned error can't find the container with id 8d45f185f8a4af874ecb94007c48e34fe047fa55b2b59d0fca3482c3c7c838e4 Sep 08 13:17:04.453986 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.453964 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjht9" Sep 08 13:17:04.458356 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.458330 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e8eca3_fd82_42d5_8969_1f100287f790.slice/crio-589ddf3f27057d555b707cae86f1d607d872caef09a76defeece11f134ba0c46 WatchSource:0}: Error finding container 589ddf3f27057d555b707cae86f1d607d872caef09a76defeece11f134ba0c46: Status 404 returned error can't find the container with id 589ddf3f27057d555b707cae86f1d607d872caef09a76defeece11f134ba0c46 Sep 08 13:17:04.459684 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.459657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:04.465654 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.465631 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c56b6bb_eb24_48b2_8951_b3cb14b77bdc.slice/crio-63eb5453bfbb36765eba9b26598191a61c032443b871c840a5783a73a1c901ae WatchSource:0}: Error finding container 63eb5453bfbb36765eba9b26598191a61c032443b871c840a5783a73a1c901ae: Status 404 returned error can't find the container with id 63eb5453bfbb36765eba9b26598191a61c032443b871c840a5783a73a1c901ae Sep 08 13:17:04.466262 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.466238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khjgp" Sep 08 13:17:04.472657 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.472631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:04.476837 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.476796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" Sep 08 13:17:04.477538 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.477512 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263e761f_f62d_4a21_a3fc_ae988ab70137.slice/crio-d1efa35126a63c8ececa525070a9c99aa460a6f7def6d7f3711081d91a05ff94 WatchSource:0}: Error finding container d1efa35126a63c8ececa525070a9c99aa460a6f7def6d7f3711081d91a05ff94: Status 404 returned error can't find the container with id d1efa35126a63c8ececa525070a9c99aa460a6f7def6d7f3711081d91a05ff94 Sep 08 13:17:04.481366 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.481214 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3933738_fa0b_4671_8b62_c94a32826690.slice/crio-8d9621f1a296bc0fda55486c6ff58020e4c2376e1a409caefbb8dc5800e174e9 WatchSource:0}: Error finding container 8d9621f1a296bc0fda55486c6ff58020e4c2376e1a409caefbb8dc5800e174e9: Status 404 returned error can't find the container with id 8d9621f1a296bc0fda55486c6ff58020e4c2376e1a409caefbb8dc5800e174e9 Sep 08 13:17:04.484374 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.484347 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d397dd_0678_41ca_9131_56ea93caac19.slice/crio-ab304ed7dc3d24d765fc1c56c42062417603d5610256d6f34fd7152252613180 WatchSource:0}: Error finding container ab304ed7dc3d24d765fc1c56c42062417603d5610256d6f34fd7152252613180: Status 404 returned error can't find the container with id ab304ed7dc3d24d765fc1c56c42062417603d5610256d6f34fd7152252613180 Sep 08 13:17:04.488334 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:04.488086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2447a82f_ab9b_433e_9153_4c68c150b36a.slice/crio-ad1b889b2e21ed8915b3ca8c224fbc97265a396c7bb26b7a79f59a0fe71b3ab6 WatchSource:0}: Error finding container ad1b889b2e21ed8915b3ca8c224fbc97265a396c7bb26b7a79f59a0fe71b3ab6: Status 404 returned error can't find the container with id ad1b889b2e21ed8915b3ca8c224fbc97265a396c7bb26b7a79f59a0fe71b3ab6 Sep 08 13:17:04.743643 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.743543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:04.743819 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.743665 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:04.743819 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.743730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:05.743714245 +0000 UTC m=+3.951372319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:04.844491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.844439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:04.844688 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.844608 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:04.844688 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.844682 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:05.844661476 +0000 UTC m=+4.052319557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:04.945757 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:04.945704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:04.945990 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.945909 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:04.945990 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.945935 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:04.945990 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.945949 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:04.946176 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:04.946049 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:05.946014279 +0000 UTC m=+4.153672359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:05.173165 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.172897 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:12:04 +0000 UTC" deadline="2028-05-06 05:27:54.374166622 +0000 UTC" Sep 08 13:17:05.173165 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.173017 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14536h10m49.201154471s" Sep 08 13:17:05.282250 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.282112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khjgp" event={"ID":"c3933738-fa0b-4671-8b62-c94a32826690","Type":"ContainerStarted","Data":"8d9621f1a296bc0fda55486c6ff58020e4c2376e1a409caefbb8dc5800e174e9"} Sep 08 13:17:05.284764 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.284658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjht9" event={"ID":"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc","Type":"ContainerStarted","Data":"63eb5453bfbb36765eba9b26598191a61c032443b871c840a5783a73a1c901ae"} Sep 08 13:17:05.289434 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.289318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" event={"ID":"9166ddbf-c8df-4a71-af63-48d1a617df9d","Type":"ContainerStarted","Data":"8d45f185f8a4af874ecb94007c48e34fe047fa55b2b59d0fca3482c3c7c838e4"} Sep 08 13:17:05.294675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.294629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lftlm" event={"ID":"36c6c87a-d2f6-4661-bee2-a959a52e0780","Type":"ContainerStarted","Data":"6046e79eb0842c620db43c3d93c8b62c77242eb3b20475191471dd2780777a38"} Sep 08 13:17:05.298527 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.298487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerStarted","Data":"ad1b889b2e21ed8915b3ca8c224fbc97265a396c7bb26b7a79f59a0fe71b3ab6"} Sep 08 13:17:05.300868 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.300831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"d1efa35126a63c8ececa525070a9c99aa460a6f7def6d7f3711081d91a05ff94"} Sep 08 13:17:05.304923 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.304831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxnqs" event={"ID":"64e8eca3-fd82-42d5-8969-1f100287f790","Type":"ContainerStarted","Data":"589ddf3f27057d555b707cae86f1d607d872caef09a76defeece11f134ba0c46"} Sep 08 13:17:05.308866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.308826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4rndf" event={"ID":"b47451f9-07f2-4c1a-a703-25a40da89a5a","Type":"ContainerStarted","Data":"90b72d6f43760d97c4e7f0c21c0f4ae4c5045cfe27f12da794e3d5976f8d2f76"} Sep 08 13:17:05.311176 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.311136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-58hdt" event={"ID":"c0d397dd-0678-41ca-9131-56ea93caac19","Type":"ContainerStarted","Data":"ab304ed7dc3d24d765fc1c56c42062417603d5610256d6f34fd7152252613180"} Sep 08 13:17:05.754978 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.754336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:05.754978 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.754496 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:05.754978 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.754566 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:07.754545703 +0000 UTC m=+5.962203807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:05.856421 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.855556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:05.856421 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.855803 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:05.856421 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.855999 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:07.855956648 +0000 UTC m=+6.063614748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:05.956853 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:05.956806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:05.957091 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.957062 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:05.957164 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.957101 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:05.957164 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.957117 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:05.957343 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:05.957199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:07.957176504 +0000 UTC m=+6.164834604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:06.174193 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:06.174085 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:12:04 +0000 UTC" deadline="2028-04-22 17:33:40.497247269 +0000 UTC" Sep 08 13:17:06.174193 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:06.174135 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14212h16m34.323118133s" Sep 08 13:17:06.269971 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:06.269936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:06.270343 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:06.270103 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:06.270343 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:06.270150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:06.270343 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:06.270268 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:06.270343 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:06.269950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:06.270594 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:06.270377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:07.774009 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:07.773956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:07.774542 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.774148 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:07.774542 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.774222 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:11.774202049 +0000 UTC m=+9.981860151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:07.874482 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:07.874433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:07.874692 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.874635 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:07.874770 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.874705 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:11.874688033 +0000 UTC m=+10.082346123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:07.975881 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:07.975160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:07.975881 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.975397 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:07.975881 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.975426 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:07.975881 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.975442 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:07.975881 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:07.975518 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:11.975490756 +0000 UTC m=+10.183148848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:08.270199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:08.270094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:08.270199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:08.270128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:08.270199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:08.270187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:08.270493 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:08.270294 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:08.271007 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:08.270774 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:08.271007 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:08.270881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:10.270528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:10.270406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:10.271035 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:10.270565 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:10.271035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:10.270665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:10.271035 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:10.270767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:10.271035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:10.270822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:10.271035 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:10.270886 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:11.814312 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:11.814256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:11.814888 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:11.814468 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:11.814888 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:11.814532 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:19.814513318 +0000 UTC m=+18.022171393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:11.915166 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:11.915061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:11.915333 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:11.915234 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:11.915333 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:11.915304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:19.915285013 +0000 UTC m=+18.122943094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:12.015693 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:12.015646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:12.015934 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.015804 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:12.015934 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.015822 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:12.015934 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.015835 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:12.015934 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.015893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:20.015876372 +0000 UTC m=+18.223534450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:12.269856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:12.269767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:12.270045 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.269968 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:12.270867 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:12.270531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:12.270867 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.270690 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:12.270867 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:12.270758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:12.270867 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:12.270837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:14.270298 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:14.270257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:14.270936 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:14.270321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:14.270936 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:14.270257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:14.270936 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:14.270417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:14.270936 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:14.270498 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:14.270936 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:14.270599 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:16.269780 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:16.269742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:16.270275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:16.269743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:16.270275 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:16.269895 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:16.270275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:16.269754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:16.270275 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:16.269975 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:16.270275 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:16.270045 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:18.270391 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:18.270291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:18.270391 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:18.270327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:18.270391 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:18.270291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:18.270968 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:18.270435 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:18.270968 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:18.270537 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:18.270968 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:18.270617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:19.872795 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:19.872749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:19.873327 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:19.872949 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:19.873327 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:19.873044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:17:35.873022251 +0000 UTC m=+34.080680327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:19.973482 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:19.973420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:19.973673 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:19.973600 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:19.973750 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:19.973691 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:17:35.973670667 +0000 UTC m=+34.181328741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:20.074013 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:20.073975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:20.074207 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.074141 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:20.074207 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.074161 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:20.074207 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.074174 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:20.074354 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.074232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:36.074215379 +0000 UTC m=+34.281873477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:20.269952 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:20.269844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:20.269952 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:20.269853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:20.270176 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:20.269853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:20.270176 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.270007 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:20.270176 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.270103 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:20.270308 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:20.270199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:22.270934 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:22.270879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:22.271376 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:22.271028 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:22.271615 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:22.271594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:22.271752 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:22.271734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:22.271819 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:22.271804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:22.271935 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:22.271903 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:23.352396 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.352267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" event={"ID":"fc722220b0bff438767064ce86b64eb2","Type":"ContainerStarted","Data":"edff85bcefd018302cbeacd11750f67033802d17f9ffd07c1c370f232cf1e00b"} Sep 08 13:17:23.354628 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.354593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"ddb4885945c67480b2c8cc61a8ce48c5785d01bf51cdebb8d5d92abebc55b2ff"} Sep 08 13:17:23.354757 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.354680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"813a3097eb6cb18887c1f62239769d2f78f866dd8439f9a907cdcaa052ba8481"} Sep 08 13:17:23.355932 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.355882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" event={"ID":"785ef9eb1aa6b96c391200ecd99bd0ff","Type":"ContainerStarted","Data":"05f0d79cfd5e940967afe3d6f6ae7911dc81765932bc3a4ceaa668f56a57de06"} Sep 08 13:17:23.357891 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.357865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lftlm" event={"ID":"36c6c87a-d2f6-4661-bee2-a959a52e0780","Type":"ContainerStarted","Data":"49ab139e0dec026222f89e3b438624a3a5736991b88e8625b228a559d45680bb"} Sep 08 13:17:23.368665 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:23.368610 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-86.ec2.internal" podStartSLOduration=20.368594814 podStartE2EDuration="20.368594814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:23.368534323 +0000 UTC m=+21.576192419" watchObservedRunningTime="2026-09-08 13:17:23.368594814 +0000 UTC m=+21.576252911" Sep 08 13:17:24.270321 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.270009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:24.270490 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.270016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:24.270490 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:24.270364 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:24.270490 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:24.270472 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:24.270676 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.270063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:24.270676 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:24.270589 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:24.362427 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.362388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjht9" event={"ID":"1c56b6bb-eb24-48b2-8951-b3cb14b77bdc","Type":"ContainerStarted","Data":"9ae877b4a10ed743bf066ebbd2b8d7124962b7ed746ed419b30631330171f0b8"} Sep 08 13:17:24.364193 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.364157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" event={"ID":"9166ddbf-c8df-4a71-af63-48d1a617df9d","Type":"ContainerStarted","Data":"18fbbbf7e3ea8a059f861878c123daeaf6577bb39dd67905df036f0d8c32d334"} Sep 08 13:17:24.366121 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.366092 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="b7b2a06ea2f5d00bc5523de4908c3588c6501a65549dfa27496a8806bd3f2725" exitCode=0 Sep 08 13:17:24.366234 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.366180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"b7b2a06ea2f5d00bc5523de4908c3588c6501a65549dfa27496a8806bd3f2725"} Sep 08 13:17:24.368413 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.368388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:24.368882 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.368858 2576 generic.go:356] "Generic (PLEG): container finished" podID="263e761f-f62d-4a21-a3fc-ae988ab70137" containerID="ddb4885945c67480b2c8cc61a8ce48c5785d01bf51cdebb8d5d92abebc55b2ff" exitCode=1 Sep 08 13:17:24.368990 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.368906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerDied","Data":"ddb4885945c67480b2c8cc61a8ce48c5785d01bf51cdebb8d5d92abebc55b2ff"} Sep 08 13:17:24.370725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.370697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxnqs" event={"ID":"64e8eca3-fd82-42d5-8969-1f100287f790","Type":"ContainerStarted","Data":"8c6f967fdbb69f6d867dafa3859bb64c1a6976a75400ce14e81407a5d465e16b"} Sep 08 13:17:24.372584 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.372551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4rndf" event={"ID":"b47451f9-07f2-4c1a-a703-25a40da89a5a","Type":"ContainerStarted","Data":"3cced959434922ff8631a68611d537f9116d21990774d82043c1949fa540a518"} Sep 08 13:17:24.374226 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.374203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-58hdt" event={"ID":"c0d397dd-0678-41ca-9131-56ea93caac19","Type":"ContainerStarted","Data":"101904555fc51807863b9839543c04349bca37258956434dc770584477e878d8"} Sep 08 13:17:24.377954 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.377897 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lftlm" podStartSLOduration=3.853067852 podStartE2EDuration="22.377881969s" totalImagesPullingTime="18.524814117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:23.385001122 +0000 UTC m=+21.592659237" watchObservedRunningTime="2026-09-08 13:17:24.377881969 +0000 UTC m=+22.585540065" Sep 08 13:17:24.378450 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.378415 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjht9" podStartSLOduration=3.924278546 podStartE2EDuration="22.378401943s" totalImagesPullingTime="18.454123397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:24.377647687 +0000 UTC m=+22.585305809" watchObservedRunningTime="2026-09-08 13:17:24.378401943 +0000 UTC m=+22.586060041" Sep 08 13:17:24.393313 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.393245 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lxnqs" podStartSLOduration=3.932052824 podStartE2EDuration="22.393222598s" totalImagesPullingTime="18.461169774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:24.393023795 +0000 UTC m=+22.600681928" watchObservedRunningTime="2026-09-08 13:17:24.393222598 +0000 UTC m=+22.600880697" Sep 08 13:17:24.410825 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.410767 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-58hdt" podStartSLOduration=7.524108699 podStartE2EDuration="21.410750255s" totalImagesPullingTime="13.886641556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:24.410171733 +0000 UTC m=+22.617829839" watchObservedRunningTime="2026-09-08 13:17:24.410750255 +0000 UTC m=+22.618408351" Sep 08 13:17:24.455600 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.455449 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4rndf" podStartSLOduration=3.42839784 podStartE2EDuration="22.455425208s" totalImagesPullingTime="19.027027368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:24.454878989 +0000 UTC m=+22.662537103" watchObservedRunningTime="2026-09-08 13:17:24.455425208 +0000 UTC m=+22.663083305" Sep 08 13:17:24.498863 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.498822 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:24.560855 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.560774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:24.653588 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.653549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:24.820371 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:24.820286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:25.331053 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.331027 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 13:17:25.378524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.378441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khjgp" event={"ID":"c3933738-fa0b-4671-8b62-c94a32826690","Type":"ContainerStarted","Data":"b0dd30e7a600e76c1bb9296ec7d9af0b5fe96f2a1603691ccea44ec791df4ee8"} Sep 08 13:17:25.380893 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.380864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" event={"ID":"9166ddbf-c8df-4a71-af63-48d1a617df9d","Type":"ContainerStarted","Data":"e540647a7afc58e49637e178b42d2733a5ac81b03200b38bde4c7157fa5674d4"} Sep 08 13:17:25.383339 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.383258 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:25.383700 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.383670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"90ac9402108e2aec78157544252e7b4e4d99d28a0c9648ff0c69a525fa66ecf4"} Sep 08 13:17:25.386148 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.385367 2576 generic.go:356] "Generic (PLEG): container finished" podID="785ef9eb1aa6b96c391200ecd99bd0ff" containerID="0d7083231fb053f4a26ef365ac2a2512e3afc8a0a7cc5622c7e14f39b24ea8c3" exitCode=0 Sep 08 13:17:25.386148 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.385996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" event={"ID":"785ef9eb1aa6b96c391200ecd99bd0ff","Type":"ContainerDied","Data":"0d7083231fb053f4a26ef365ac2a2512e3afc8a0a7cc5622c7e14f39b24ea8c3"} Sep 08 13:17:25.397118 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.397056 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-khjgp" podStartSLOduration=3.903918237 podStartE2EDuration="22.397034143s" totalImagesPullingTime="18.493115906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:25.396161064 +0000 UTC m=+23.603819178" watchObservedRunningTime="2026-09-08 13:17:25.397034143 +0000 UTC m=+23.604692242" Sep 08 13:17:25.516907 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.516626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:25.708737 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:25.708619 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:26.207191 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.207026 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T13:17:25.331047766Z","UUID":"4e60d964-2ec4-4852-9310-d5a5d06cd56c","Handler":null,"Name":"","Endpoint":""} Sep 08 13:17:26.209095 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.209069 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 13:17:26.209220 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.209113 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 13:17:26.269413 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.269378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:26.269578 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:26.269523 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:26.269578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.269377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:26.269710 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.269377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:26.269710 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:26.269622 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:26.269710 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:26.269684 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:26.391455 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.391428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:26.392864 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.392827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"2ac74b52246337134513e88cb83c71f7e63da692176e27cc0f166de822aa2625"} Sep 08 13:17:26.393023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.392946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"a1c906c538ae231737727b66b0db330cf71140c0bba999b9e7547bb77c12b874"} Sep 08 13:17:26.393023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.392998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"9acf2f58c27cc77fb27cc1e2f6cb8dc1c292fb8d8360b335200c46734135d422"} Sep 08 13:17:26.396195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.396161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" event={"ID":"785ef9eb1aa6b96c391200ecd99bd0ff","Type":"ContainerStarted","Data":"b2cdb42df5493163f99650ca6ffb884bf3d05f6ca032ef2bbf2bd32b23510221"} Sep 08 13:17:26.414808 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:26.414749 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-86.ec2.internal" podStartSLOduration=23.414731197 podStartE2EDuration="23.414731197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:26.414668145 +0000 UTC m=+24.622326260" watchObservedRunningTime="2026-09-08 13:17:26.414731197 +0000 UTC m=+24.622389293" Sep 08 13:17:27.401795 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.401741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" event={"ID":"9166ddbf-c8df-4a71-af63-48d1a617df9d","Type":"ContainerStarted","Data":"d335366a80ddb06ce6e3a816b687b4822b7e39f3b20011095f71bb7e9e8551e6"} Sep 08 13:17:27.569548 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.569503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:27.570329 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.570306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:27.587201 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.587139 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kphn" podStartSLOduration=4.241541447 podStartE2EDuration="25.587116412s" totalImagesPullingTime="21.345574965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:27.420629009 +0000 UTC m=+25.628287104" watchObservedRunningTime="2026-09-08 13:17:27.587116412 +0000 UTC m=+25.794774510" Sep 08 13:17:27.951620 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.951528 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:27.952130 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:27.952107 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-58hdt" Sep 08 13:17:28.019033 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:28.018998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:28.269864 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:28.269778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:28.270033 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:28.269944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:28.270033 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:28.269968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:28.270157 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:28.270059 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:28.270157 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:28.269942 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:28.270248 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:28.270149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:29.407870 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:29.407777 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="14ed91c4f659723e92abed32d3d25aa1ed46805bdc508067be7eaf8fcbbcac23" exitCode=0 Sep 08 13:17:29.408299 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:29.407868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"14ed91c4f659723e92abed32d3d25aa1ed46805bdc508067be7eaf8fcbbcac23"} Sep 08 13:17:29.411363 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:29.411340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:29.411817 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:29.411796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"bc5007a5c910599648e807af129914f74de5ce5c0b3b114e4e7351157c677eb3"} Sep 08 13:17:30.269741 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:30.269709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:30.269888 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:30.269765 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:30.269888 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:30.269715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:30.269888 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:30.269821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:30.270055 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:30.269942 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:30.270055 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:30.269978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:30.416686 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:30.416650 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="c2c92ec09e07912e25e466b01ff8a13677c66e972bb28ae2bffa291c1af0ddc8" exitCode=0 Sep 08 13:17:30.417145 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:30.416704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"c2c92ec09e07912e25e466b01ff8a13677c66e972bb28ae2bffa291c1af0ddc8"} Sep 08 13:17:31.421799 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.421768 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="d83c7ba25d97519775cf39bef1dc8106a396024a40a3be41c3a9f906bb35c5d9" exitCode=0 Sep 08 13:17:31.422199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.421849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"d83c7ba25d97519775cf39bef1dc8106a396024a40a3be41c3a9f906bb35c5d9"} Sep 08 13:17:31.425641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.425622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:31.426031 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.426009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"66defae465a8942fe0d165f755fabafa0f67fddd0b5f2be471f505fab07683c8"} Sep 08 13:17:31.426285 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.426264 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:31.426420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.426404 2576 scope.go:117] "RemoveContainer" containerID="ddb4885945c67480b2c8cc61a8ce48c5785d01bf51cdebb8d5d92abebc55b2ff" Sep 08 13:17:31.443227 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:31.443200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:32.270716 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.270676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:32.270886 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:32.270768 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:32.270886 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.270782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:32.270886 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.270810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:32.271072 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:32.270883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:32.271072 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:32.270999 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:32.431802 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.431770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:17:32.432269 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.432170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" event={"ID":"263e761f-f62d-4a21-a3fc-ae988ab70137","Type":"ContainerStarted","Data":"dfcaf64a740dbcf8b27217e8f2a0ecb5bb7ece3d276ce27b5003f03693ecfaea"} Sep 08 13:17:32.432404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.432384 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:32.432482 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.432470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:32.448067 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.448040 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:17:32.464953 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:32.464890 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" podStartSLOduration=9.083254836 podStartE2EDuration="29.46487463s" totalImagesPullingTime="20.381619794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:32.464299427 +0000 UTC m=+30.671957556" watchObservedRunningTime="2026-09-08 13:17:32.46487463 +0000 UTC m=+30.672532723" Sep 08 13:17:33.262676 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.262635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vxxgm"] Sep 08 13:17:33.262855 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.262831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:33.262997 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:33.262967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:33.266410 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.266380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rfk4c"] Sep 08 13:17:33.266566 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.266501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:33.266631 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:33.266606 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:33.267272 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.267227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4sft"] Sep 08 13:17:33.267388 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:33.267349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:33.267486 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:33.267463 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:35.270256 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:35.270164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:35.270256 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:35.270207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:35.271126 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.270279 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:35.271126 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:35.270207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:35.271126 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.270331 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:35.271126 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.270440 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:35.891567 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:35.891528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:35.891860 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.891658 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:35.891860 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.891733 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:18:07.891713812 +0000 UTC m=+66.099371902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 13:17:35.992286 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:35.992245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:35.992488 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.992454 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:35.992559 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:35.992535 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret podName:1a1ab0ac-6fb8-4aeb-995e-b356fca294dc nodeName:}" failed. No retries permitted until 2026-09-08 13:18:07.992514478 +0000 UTC m=+66.200172559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret") pod "global-pull-secret-syncer-rfk4c" (UID: "1a1ab0ac-6fb8-4aeb-995e-b356fca294dc") : object "kube-system"/"original-pull-secret" not registered Sep 08 13:17:36.093001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:36.092962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:36.093180 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:36.093113 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 13:17:36.093180 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:36.093133 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 13:17:36.093180 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:36.093145 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wgsbv for pod openshift-network-diagnostics/network-check-target-vxxgm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:36.093304 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:36.093211 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv podName:79336fc4-e089-4c83-89f5-b7259adec138 nodeName:}" failed. No retries permitted until 2026-09-08 13:18:08.093192385 +0000 UTC m=+66.300850482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wgsbv" (UniqueName: "kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv") pod "network-check-target-vxxgm" (UID: "79336fc4-e089-4c83-89f5-b7259adec138") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 13:17:37.269569 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:37.269336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:37.270007 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:37.269372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:37.270007 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:37.269663 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfk4c" podUID="1a1ab0ac-6fb8-4aeb-995e-b356fca294dc" Sep 08 13:17:37.270007 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:37.269775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:17:37.270007 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:37.269407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:37.270007 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:37.269877 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vxxgm" podUID="79336fc4-e089-4c83-89f5-b7259adec138" Sep 08 13:17:37.982637 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:37.982604 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-86.ec2.internal" event="NodeReady" Sep 08 13:17:37.982818 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:37.982749 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 13:17:38.034293 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.034257 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pgmb8"] Sep 08 13:17:38.053733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.053673 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wcczb"] Sep 08 13:17:38.053927 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.053816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.056644 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.056617 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 13:17:38.056886 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.056864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 13:17:38.057022 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.056896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8sm9m\"" Sep 08 13:17:38.059520 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.059492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgmb8"] Sep 08 13:17:38.059658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.059542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcczb"] Sep 08 13:17:38.059658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.059628 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.062276 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.062251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 13:17:38.062847 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.062821 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 13:17:38.063622 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.063368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z887n\"" Sep 08 13:17:38.063622 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.063613 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 13:17:38.162586 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.162549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:38.209495 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.209495 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da4995c-f237-4fe6-96d7-22ef1e437484-cert\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.209495 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cm7\" (UniqueName: \"kubernetes.io/projected/7da4995c-f237-4fe6-96d7-22ef1e437484-kube-api-access-42cm7\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.209772 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-tmp-dir\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.209772 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcsf\" (UniqueName: \"kubernetes.io/projected/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-kube-api-access-mfcsf\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.209772 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.209702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-config-volume\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.234823 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.234779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:38.311017 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.310976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-config-volume\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.311017 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:38.311131 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da4995c-f237-4fe6-96d7-22ef1e437484-cert\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:38.311198 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:38.811180784 +0000 UTC m=+37.018838858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cm7\" (UniqueName: \"kubernetes.io/projected/7da4995c-f237-4fe6-96d7-22ef1e437484-kube-api-access-42cm7\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-tmp-dir\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.311528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcsf\" (UniqueName: \"kubernetes.io/projected/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-kube-api-access-mfcsf\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.311866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-tmp-dir\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.311866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.311734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-config-volume\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.315583 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.315554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da4995c-f237-4fe6-96d7-22ef1e437484-cert\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.320696 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.320630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcsf\" (UniqueName: \"kubernetes.io/projected/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-kube-api-access-mfcsf\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.323369 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.323341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cm7\" (UniqueName: \"kubernetes.io/projected/7da4995c-f237-4fe6-96d7-22ef1e437484-kube-api-access-42cm7\") pod \"ingress-canary-wcczb\" (UID: \"7da4995c-f237-4fe6-96d7-22ef1e437484\") " pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.373281 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.373241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcczb" Sep 08 13:17:38.815527 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.815487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:38.815697 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:38.815652 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:38.815746 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:38.815730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:39.81571098 +0000 UTC m=+38.023369059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:17:38.990677 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:38.990646 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcczb"] Sep 08 13:17:38.994491 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:17:38.994459 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da4995c_f237_4fe6_96d7_22ef1e437484.slice/crio-30224dd4e44972c5f4d7f480920af04d5c0c60d692db42f14db7e168859144e6 WatchSource:0}: Error finding container 30224dd4e44972c5f4d7f480920af04d5c0c60d692db42f14db7e168859144e6: Status 404 returned error can't find the container with id 30224dd4e44972c5f4d7f480920af04d5c0c60d692db42f14db7e168859144e6 Sep 08 13:17:39.270208 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.269966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:17:39.270343 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.269966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:17:39.270404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.270016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:17:39.273509 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.273483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p8w4\"" Sep 08 13:17:39.274305 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.274286 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 13:17:39.274426 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.274318 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 13:17:39.274672 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.274653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 13:17:39.274731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.274678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 13:17:39.274731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.274686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-486d2\"" Sep 08 13:17:39.449731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.449694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcczb" event={"ID":"7da4995c-f237-4fe6-96d7-22ef1e437484","Type":"ContainerStarted","Data":"30224dd4e44972c5f4d7f480920af04d5c0c60d692db42f14db7e168859144e6"} Sep 08 13:17:39.452587 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.452552 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="65cdff6a14358fd9a3b772a78cb65b708c04ba26699161556c8e6eba9be2e0eb" exitCode=0 Sep 08 13:17:39.452746 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.452605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"65cdff6a14358fd9a3b772a78cb65b708c04ba26699161556c8e6eba9be2e0eb"} Sep 08 13:17:39.823594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:39.823506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:39.823762 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:39.823722 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:39.823829 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:39.823808 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:41.823788447 +0000 UTC m=+40.031446521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:17:40.458973 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:40.458937 2576 generic.go:356] "Generic (PLEG): container finished" podID="2447a82f-ab9b-433e-9153-4c68c150b36a" containerID="5c7f21f55ceeec5eaf73861f553e1362680322939fb784532a2ad60e353cdf23" exitCode=0 Sep 08 13:17:40.459470 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:40.459027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerDied","Data":"5c7f21f55ceeec5eaf73861f553e1362680322939fb784532a2ad60e353cdf23"} Sep 08 13:17:41.378366 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.378278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:41.449775 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.449738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:41.466809 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.466773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" event={"ID":"2447a82f-ab9b-433e-9153-4c68c150b36a","Type":"ContainerStarted","Data":"f8bec9ce081dab8660b7bdaaf5f20dccb92b80822e1d61c7213500a898e13c32"} Sep 08 13:17:41.493239 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.493180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lgq2l" podStartSLOduration=6.489659195 podStartE2EDuration="38.493158871s" totalImagesPullingTime="32.003499676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:41.491389382 +0000 UTC m=+39.699047491" watchObservedRunningTime="2026-09-08 13:17:41.493158871 +0000 UTC m=+39.700816969" Sep 08 13:17:41.615462 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.615434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:41.716307 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.716267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:17:41.843230 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:41.843190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:41.843429 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:41.843318 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:41.843429 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:41.843371 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:45.84335764 +0000 UTC m=+44.051015714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:17:42.470950 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:42.470891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcczb" event={"ID":"7da4995c-f237-4fe6-96d7-22ef1e437484","Type":"ContainerStarted","Data":"0630442a14790a0e032bf2f0e31b1feac28c2a4ecd785482c99c5b266a2b9c76"} Sep 08 13:17:42.489247 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:42.489195 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wcczb" podStartSLOduration=1.869436985 podStartE2EDuration="4.489175902s" totalImagesPullingTime="2.619738917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:42.488332805 +0000 UTC m=+40.695990895" watchObservedRunningTime="2026-09-08 13:17:42.489175902 +0000 UTC m=+40.696834037" Sep 08 13:17:45.870748 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:45.870706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:45.871195 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:45.870864 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:45.871195 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:45.870951 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:53.87093345 +0000 UTC m=+52.078591524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:17:53.923202 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:17:53.923145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:17:53.923710 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:53.923309 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:17:53.923710 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:17:53.923375 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:18:09.923358115 +0000 UTC m=+68.131016193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:18:04.447427 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:04.447393 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvm89" Sep 08 13:18:04.578454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:04.578415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:18:04.635908 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:04.635867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:18:04.694293 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:04.694249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:18:07.920107 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:07.920072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:18:07.922745 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:07.922725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 13:18:07.931179 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:07.931143 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 13:18:07.931249 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:07.931237 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:19:11.93121678 +0000 UTC m=+130.138874855 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : secret "metrics-daemon-secret" not found Sep 08 13:18:08.021338 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.021296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:18:08.024200 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.024180 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 13:18:08.035640 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.035602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a1ab0ac-6fb8-4aeb-995e-b356fca294dc-original-pull-secret\") pod \"global-pull-secret-syncer-rfk4c\" (UID: \"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc\") " pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:18:08.086210 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.086168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfk4c" Sep 08 13:18:08.122648 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.122604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:18:08.125561 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.125531 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 13:18:08.137194 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.137128 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 13:18:08.147213 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.147146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgsbv\" (UniqueName: \"kubernetes.io/projected/79336fc4-e089-4c83-89f5-b7259adec138-kube-api-access-wgsbv\") pod \"network-check-target-vxxgm\" (UID: \"79336fc4-e089-4c83-89f5-b7259adec138\") " pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:18:08.356612 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.356589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rfk4c"] Sep 08 13:18:08.359141 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:18:08.359091 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1ab0ac_6fb8_4aeb_995e_b356fca294dc.slice/crio-90ba9ed70ee62c4579dfc4d428049225320a8b60cdcfe08133fd4c83308e10f1 WatchSource:0}: Error finding container 90ba9ed70ee62c4579dfc4d428049225320a8b60cdcfe08133fd4c83308e10f1: Status 404 returned error can't find the container with id 90ba9ed70ee62c4579dfc4d428049225320a8b60cdcfe08133fd4c83308e10f1 Sep 08 13:18:08.394132 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.394101 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-486d2\"" Sep 08 13:18:08.401297 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.401268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:18:08.533091 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.533054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rfk4c" event={"ID":"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc","Type":"ContainerStarted","Data":"90ba9ed70ee62c4579dfc4d428049225320a8b60cdcfe08133fd4c83308e10f1"} Sep 08 13:18:08.670670 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:08.670630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vxxgm"] Sep 08 13:18:08.674696 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:18:08.674668 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79336fc4_e089_4c83_89f5_b7259adec138.slice/crio-8e9cb45c37e1b9719212799e0f2cd541d4b08a4345065d637f3937a9b221a62f WatchSource:0}: Error finding container 8e9cb45c37e1b9719212799e0f2cd541d4b08a4345065d637f3937a9b221a62f: Status 404 returned error can't find the container with id 8e9cb45c37e1b9719212799e0f2cd541d4b08a4345065d637f3937a9b221a62f Sep 08 13:18:09.537300 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:09.537256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vxxgm" event={"ID":"79336fc4-e089-4c83-89f5-b7259adec138","Type":"ContainerStarted","Data":"8e9cb45c37e1b9719212799e0f2cd541d4b08a4345065d637f3937a9b221a62f"} Sep 08 13:18:09.939287 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:09.939237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:18:09.939469 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:09.939421 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:18:09.939531 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:09.939518 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:18:41.939493525 +0000 UTC m=+100.147151615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:18:13.549699 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:13.549654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rfk4c" event={"ID":"1a1ab0ac-6fb8-4aeb-995e-b356fca294dc","Type":"ContainerStarted","Data":"f58371320db935150a663bf0df27a54cee0f0c3a40790771cc2fce475c77f95d"} Sep 08 13:18:13.569857 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:13.569661 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rfk4c" podStartSLOduration=66.069528676 podStartE2EDuration="1m10.569639078s" totalImagesPullingTime="4.500110402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:18:13.568259601 +0000 UTC m=+71.775917698" watchObservedRunningTime="2026-09-08 13:18:13.569639078 +0000 UTC m=+71.777297168" Sep 08 13:18:14.325085 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:14.325031 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:18:15.557582 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:15.557491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vxxgm" event={"ID":"79336fc4-e089-4c83-89f5-b7259adec138","Type":"ContainerStarted","Data":"68fe0ed0813501fed81ca126e9d22c13912930c38f3851c71b7df335701cdd7f"} Sep 08 13:18:15.557964 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:15.557622 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:18:15.573687 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:15.573631 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vxxgm" podStartSLOduration=66.074457675 podStartE2EDuration="1m12.573614164s" totalImagesPullingTime="6.499156489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:18:15.573163738 +0000 UTC m=+73.780821858" watchObservedRunningTime="2026-09-08 13:18:15.573614164 +0000 UTC m=+73.781272260" Sep 08 13:18:16.284952 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:16.284875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:18:41.949167 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:41.949121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:18:41.949651 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:41.949288 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 13:18:41.949651 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:18:41.949372 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls podName:452ad9d2-8123-4e69-b2ff-3cad4a9d1a68 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:45.949353146 +0000 UTC m=+164.157011220 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls") pod "dns-default-pgmb8" (UID: "452ad9d2-8123-4e69-b2ff-3cad4a9d1a68") : secret "dns-default-metrics-tls" not found Sep 08 13:18:46.563051 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:18:46.563014 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vxxgm" Sep 08 13:19:11.950370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:11.950327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:19:11.950952 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:11.950492 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 13:19:11.950952 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:11.950574 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs podName:a788c6c8-4df9-4e8b-92b5-739e9d54723f nodeName:}" failed. No retries permitted until 2026-09-08 13:21:13.950555915 +0000 UTC m=+252.158213994 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs") pod "network-metrics-daemon-b4sft" (UID: "a788c6c8-4df9-4e8b-92b5-739e9d54723f") : secret "metrics-daemon-secret" not found Sep 08 13:19:16.919986 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.919945 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw"] Sep 08 13:19:16.922020 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.921997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:16.924341 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.924311 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6"] Sep 08 13:19:16.925831 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.925809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 08 13:19:16.925990 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.925812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 13:19:16.926113 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.926083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8r56t"] Sep 08 13:19:16.926227 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.926214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:16.927689 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.927655 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wfcww\"" Sep 08 13:19:16.927789 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.927764 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 13:19:16.927854 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.927783 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 08 13:19:16.928065 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.928050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:16.934658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.934628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 08 13:19:16.934787 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.934653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 08 13:19:16.934787 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.934710 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 08 13:19:16.934905 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.934786 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:16.936529 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.936508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 08 13:19:16.936628 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.936508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 08 13:19:16.936769 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.936753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 08 13:19:16.937025 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.936849 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4jh45\"" Sep 08 13:19:16.937025 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.936767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7p2cq\"" Sep 08 13:19:16.937245 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.937228 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:16.937528 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.937505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw"] Sep 08 13:19:16.945710 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.945687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6"] Sep 08 13:19:16.946880 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.946860 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 08 13:19:16.966751 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.966719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8r56t"] Sep 08 13:19:16.983346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:16.983346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-trusted-ca\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:16.983346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea82ef72-9c22-4d59-b670-05816aabfc9b-serving-cert\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:16.983346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4b2f\" (UniqueName: \"kubernetes.io/projected/f743df81-995e-4b99-ab12-fe20e7f3439c-kube-api-access-w4b2f\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:16.983346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mxw\" (UniqueName: \"kubernetes.io/projected/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-kube-api-access-f2mxw\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:16.983698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw29k\" (UniqueName: \"kubernetes.io/projected/ea82ef72-9c22-4d59-b670-05816aabfc9b-kube-api-access-sw29k\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:16.983698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:16.983698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea82ef72-9c22-4d59-b670-05816aabfc9b-config\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:16.983698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-config\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:16.983698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:16.983586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f743df81-995e-4b99-ab12-fe20e7f3439c-serving-cert\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.011308 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.011272 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6"] Sep 08 13:19:17.013505 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.013486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.016214 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.016175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 08 13:19:17.016444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.016216 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 08 13:19:17.016444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.016366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zxt4x\"" Sep 08 13:19:17.016615 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.016445 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 08 13:19:17.016677 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.016639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:17.026770 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.026743 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dwf8v"] Sep 08 13:19:17.028426 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.028410 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-vh49l"] Sep 08 13:19:17.028549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.028532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" Sep 08 13:19:17.029833 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.029817 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9"] Sep 08 13:19:17.029970 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.029954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.031508 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.031489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" Sep 08 13:19:17.045898 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.045870 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx"] Sep 08 13:19:17.048117 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.048096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6"] Sep 08 13:19:17.048216 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.048186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.054628 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.054602 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cl7gf\"" Sep 08 13:19:17.055431 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.055409 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 08 13:19:17.055806 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.055789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:17.056104 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.056089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hz8hp\"" Sep 08 13:19:17.057856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.057843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 08 13:19:17.070303 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.070280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 13:19:17.070303 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.070290 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:17.070476 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.070374 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 13:19:17.070522 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.070477 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 08 13:19:17.070733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.070718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qtztw\"" Sep 08 13:19:17.071762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.071748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2bwhk\"" Sep 08 13:19:17.080479 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.080454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-vh49l"] Sep 08 13:19:17.081224 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.081197 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx"] Sep 08 13:19:17.084322 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.084420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2b15-db0c-4ed6-a57e-50981ebd6199-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.084420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlfnj\" (UniqueName: \"kubernetes.io/projected/e37e2b15-db0c-4ed6-a57e-50981ebd6199-kube-api-access-zlfnj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.084420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a08dca9c-b007-44e2-9183-a296400a0c8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.084576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqkz4\" (UniqueName: \"kubernetes.io/projected/a693abd4-b6c1-4e97-adee-348f156174ce-kube-api-access-nqkz4\") pod \"volume-data-source-validator-695c895bd6-89hl9\" (UID: \"a693abd4-b6c1-4e97-adee-348f156174ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" Sep 08 13:19:17.084576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea82ef72-9c22-4d59-b670-05816aabfc9b-config\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.084576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-config\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.084576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f743df81-995e-4b99-ab12-fe20e7f3439c-serving-cert\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.084765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.084765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-trusted-ca\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.084765 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea82ef72-9c22-4d59-b670-05816aabfc9b-serving-cert\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.084932 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.084765 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:17.084932 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.084838 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.584819138 +0000 UTC m=+135.792477217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.084766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e37e2b15-db0c-4ed6-a57e-50981ebd6199-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4b2f\" (UniqueName: \"kubernetes.io/projected/f743df81-995e-4b99-ab12-fe20e7f3439c-kube-api-access-w4b2f\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wzjr\" (UniqueName: \"kubernetes.io/projected/3e355470-4b4b-4b19-9816-3700352d3df2-kube-api-access-4wzjr\") pod \"network-check-source-685456655f-dwf8v\" (UID: \"3e355470-4b4b-4b19-9816-3700352d3df2\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea82ef72-9c22-4d59-b670-05816aabfc9b-config\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mxw\" (UniqueName: \"kubernetes.io/projected/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-kube-api-access-f2mxw\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw29k\" (UniqueName: \"kubernetes.io/projected/ea82ef72-9c22-4d59-b670-05816aabfc9b-kube-api-access-sw29k\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.085390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085392 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-config\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.085792 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.085586 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f743df81-995e-4b99-ab12-fe20e7f3439c-trusted-ca\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.087075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.087057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f743df81-995e-4b99-ab12-fe20e7f3439c-serving-cert\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.087127 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.087087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea82ef72-9c22-4d59-b670-05816aabfc9b-serving-cert\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.104481 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.104452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dwf8v"] Sep 08 13:19:17.121367 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.121329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw29k\" (UniqueName: \"kubernetes.io/projected/ea82ef72-9c22-4d59-b670-05816aabfc9b-kube-api-access-sw29k\") pod \"service-ca-operator-859f94c4b-b5xx6\" (UID: \"ea82ef72-9c22-4d59-b670-05816aabfc9b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.121531 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.121510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4b2f\" (UniqueName: \"kubernetes.io/projected/f743df81-995e-4b99-ab12-fe20e7f3439c-kube-api-access-w4b2f\") pod \"console-operator-85b454874b-8r56t\" (UID: \"f743df81-995e-4b99-ab12-fe20e7f3439c\") " pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.127240 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.127215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mxw\" (UniqueName: \"kubernetes.io/projected/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-kube-api-access-f2mxw\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.129351 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.129320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9"] Sep 08 13:19:17.186664 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e37e2b15-db0c-4ed6-a57e-50981ebd6199-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.186664 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wzjr\" (UniqueName: \"kubernetes.io/projected/3e355470-4b4b-4b19-9816-3700352d3df2-kube-api-access-4wzjr\") pod \"network-check-source-685456655f-dwf8v\" (UID: \"3e355470-4b4b-4b19-9816-3700352d3df2\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" Sep 08 13:19:17.186664 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.186875 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.186739 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:17.186875 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.186791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.68677854 +0000 UTC m=+135.894436615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:17.186875 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2b15-db0c-4ed6-a57e-50981ebd6199-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.187028 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlfnj\" (UniqueName: \"kubernetes.io/projected/e37e2b15-db0c-4ed6-a57e-50981ebd6199-kube-api-access-zlfnj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.187028 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a08dca9c-b007-44e2-9183-a296400a0c8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.187028 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.186988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqkz4\" (UniqueName: \"kubernetes.io/projected/a693abd4-b6c1-4e97-adee-348f156174ce-kube-api-access-nqkz4\") pod \"volume-data-source-validator-695c895bd6-89hl9\" (UID: \"a693abd4-b6c1-4e97-adee-348f156174ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" Sep 08 13:19:17.187144 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.187034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.187144 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.187072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtgbj\" (UniqueName: \"kubernetes.io/projected/71123832-4304-40ff-a6d3-5b2006237601-kube-api-access-vtgbj\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.187309 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.187293 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e37e2b15-db0c-4ed6-a57e-50981ebd6199-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.187629 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.187612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a08dca9c-b007-44e2-9183-a296400a0c8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.189207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.189190 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e37e2b15-db0c-4ed6-a57e-50981ebd6199-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.204333 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.204298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wzjr\" (UniqueName: \"kubernetes.io/projected/3e355470-4b4b-4b19-9816-3700352d3df2-kube-api-access-4wzjr\") pod \"network-check-source-685456655f-dwf8v\" (UID: \"3e355470-4b4b-4b19-9816-3700352d3df2\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" Sep 08 13:19:17.207627 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.207599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqkz4\" (UniqueName: \"kubernetes.io/projected/a693abd4-b6c1-4e97-adee-348f156174ce-kube-api-access-nqkz4\") pod \"volume-data-source-validator-695c895bd6-89hl9\" (UID: \"a693abd4-b6c1-4e97-adee-348f156174ce\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" Sep 08 13:19:17.209317 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.209295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlfnj\" (UniqueName: \"kubernetes.io/projected/e37e2b15-db0c-4ed6-a57e-50981ebd6199-kube-api-access-zlfnj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgkt6\" (UID: \"e37e2b15-db0c-4ed6-a57e-50981ebd6199\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.238822 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.238784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" Sep 08 13:19:17.245642 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.245578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:17.249950 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.249901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:17.288645 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.288127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtgbj\" (UniqueName: \"kubernetes.io/projected/71123832-4304-40ff-a6d3-5b2006237601-kube-api-access-vtgbj\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.288645 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.288289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.288645 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.288399 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 13:19:17.288645 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.288457 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls podName:71123832-4304-40ff-a6d3-5b2006237601 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.788439544 +0000 UTC m=+135.996097621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-gxszx" (UID: "71123832-4304-40ff-a6d3-5b2006237601") : secret "samples-operator-tls" not found Sep 08 13:19:17.307672 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.307618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtgbj\" (UniqueName: \"kubernetes.io/projected/71123832-4304-40ff-a6d3-5b2006237601-kube-api-access-vtgbj\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.322541 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.322507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" Sep 08 13:19:17.337651 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.337617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" Sep 08 13:19:17.349728 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.349678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" Sep 08 13:19:17.350070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.350047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:17.451834 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.451754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:17.510653 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.510524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6"] Sep 08 13:19:17.513190 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:17.513164 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea82ef72_9c22_4d59_b670_05816aabfc9b.slice/crio-9335ef2a63df6188c338b895209b322af12a8db40b3e58a3180ea115efd212d2 WatchSource:0}: Error finding container 9335ef2a63df6188c338b895209b322af12a8db40b3e58a3180ea115efd212d2: Status 404 returned error can't find the container with id 9335ef2a63df6188c338b895209b322af12a8db40b3e58a3180ea115efd212d2 Sep 08 13:19:17.515429 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.515392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8r56t"] Sep 08 13:19:17.519784 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:17.518075 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf743df81_995e_4b99_ab12_fe20e7f3439c.slice/crio-d46191758dc834eab23d20188d525501f9810d054169cd7448bb4efe2332b86f WatchSource:0}: Error finding container d46191758dc834eab23d20188d525501f9810d054169cd7448bb4efe2332b86f: Status 404 returned error can't find the container with id d46191758dc834eab23d20188d525501f9810d054169cd7448bb4efe2332b86f Sep 08 13:19:17.590340 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.590306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:17.590484 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.590453 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:17.590536 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.590519 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:18.590502043 +0000 UTC m=+136.798160137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:17.597656 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.597630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6"] Sep 08 13:19:17.600294 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:17.600271 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37e2b15_db0c_4ed6_a57e_50981ebd6199.slice/crio-43c95868a4d3156bf840a4fa16643ce2a6e788988eb523ebb5c018efb705f5ce WatchSource:0}: Error finding container 43c95868a4d3156bf840a4fa16643ce2a6e788988eb523ebb5c018efb705f5ce: Status 404 returned error can't find the container with id 43c95868a4d3156bf840a4fa16643ce2a6e788988eb523ebb5c018efb705f5ce Sep 08 13:19:17.620205 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.620179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dwf8v"] Sep 08 13:19:17.623171 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:17.623136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e355470_4b4b_4b19_9816_3700352d3df2.slice/crio-c874fdc6ab4cb4b87d1d4252454848ab78947bda1127c1804e43fa1540168912 WatchSource:0}: Error finding container c874fdc6ab4cb4b87d1d4252454848ab78947bda1127c1804e43fa1540168912: Status 404 returned error can't find the container with id c874fdc6ab4cb4b87d1d4252454848ab78947bda1127c1804e43fa1540168912 Sep 08 13:19:17.641777 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.641750 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9"] Sep 08 13:19:17.648876 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:17.648850 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda693abd4_b6c1_4e97_adee_348f156174ce.slice/crio-dc022229b86c790f56349cc96f397c7ea335d696764af91f6149f713dd913a4a WatchSource:0}: Error finding container dc022229b86c790f56349cc96f397c7ea335d696764af91f6149f713dd913a4a: Status 404 returned error can't find the container with id dc022229b86c790f56349cc96f397c7ea335d696764af91f6149f713dd913a4a Sep 08 13:19:17.690652 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.690624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:17.690801 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.690771 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:17.690848 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.690837 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:18.690819453 +0000 UTC m=+136.898477527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:17.710556 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.710464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" event={"ID":"a693abd4-b6c1-4e97-adee-348f156174ce","Type":"ContainerStarted","Data":"dc022229b86c790f56349cc96f397c7ea335d696764af91f6149f713dd913a4a"} Sep 08 13:19:17.711620 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.711591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" event={"ID":"e37e2b15-db0c-4ed6-a57e-50981ebd6199","Type":"ContainerStarted","Data":"43c95868a4d3156bf840a4fa16643ce2a6e788988eb523ebb5c018efb705f5ce"} Sep 08 13:19:17.712823 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.712794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerStarted","Data":"d46191758dc834eab23d20188d525501f9810d054169cd7448bb4efe2332b86f"} Sep 08 13:19:17.714074 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.714046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" event={"ID":"ea82ef72-9c22-4d59-b670-05816aabfc9b","Type":"ContainerStarted","Data":"9335ef2a63df6188c338b895209b322af12a8db40b3e58a3180ea115efd212d2"} Sep 08 13:19:17.716242 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.716217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" event={"ID":"3e355470-4b4b-4b19-9816-3700352d3df2","Type":"ContainerStarted","Data":"f8d006019c59edd5ff7e55e6b38074b20fbb08a2bee611b6e2cb1946c3763f70"} Sep 08 13:19:17.716350 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.716263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" event={"ID":"3e355470-4b4b-4b19-9816-3700352d3df2","Type":"ContainerStarted","Data":"c874fdc6ab4cb4b87d1d4252454848ab78947bda1127c1804e43fa1540168912"} Sep 08 13:19:17.751585 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.748541 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-dwf8v" podStartSLOduration=1.748518628 podStartE2EDuration="1.748518628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:17.748113461 +0000 UTC m=+135.955771558" watchObservedRunningTime="2026-09-08 13:19:17.748518628 +0000 UTC m=+135.956176724" Sep 08 13:19:17.791931 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:17.791872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:17.792097 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.792062 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 13:19:17.792146 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:17.792135 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls podName:71123832-4304-40ff-a6d3-5b2006237601 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:18.792119072 +0000 UTC m=+136.999777147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-gxszx" (UID: "71123832-4304-40ff-a6d3-5b2006237601") : secret "samples-operator-tls" not found Sep 08 13:19:18.599867 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:18.599259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:18.599867 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.599432 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:18.599867 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.599507 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:20.599486184 +0000 UTC m=+138.807144281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:18.701181 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:18.700574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:18.701181 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.700728 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:18.701181 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.700799 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:20.700779342 +0000 UTC m=+138.908437423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:18.801146 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:18.801106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:18.802117 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.801388 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 13:19:18.802117 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:18.801461 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls podName:71123832-4304-40ff-a6d3-5b2006237601 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:20.801440479 +0000 UTC m=+139.009098563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-gxszx" (UID: "71123832-4304-40ff-a6d3-5b2006237601") : secret "samples-operator-tls" not found Sep 08 13:19:19.725389 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:19.725316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" event={"ID":"a693abd4-b6c1-4e97-adee-348f156174ce","Type":"ContainerStarted","Data":"915cb3c09f695f24964e56719fd062bccb5dc8ec6de90a3a21866dd7b8266453"} Sep 08 13:19:19.741424 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:19.741369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-89hl9" podStartSLOduration=2.380806132 podStartE2EDuration="3.741349752s" totalImagesPullingTime="1.36054362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:19.740738484 +0000 UTC m=+137.948396599" watchObservedRunningTime="2026-09-08 13:19:19.741349752 +0000 UTC m=+137.949007847" Sep 08 13:19:19.830743 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:19.830701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:20.617862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.617820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:20.618027 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.617968 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:20.618120 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.618041 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:24.618020137 +0000 UTC m=+142.825678224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:20.718346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.718285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:20.718542 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.718500 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:20.718606 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.718562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:24.718542878 +0000 UTC m=+142.926200975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:20.731449 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.731408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" event={"ID":"e37e2b15-db0c-4ed6-a57e-50981ebd6199","Type":"ContainerStarted","Data":"73ca0acc72690795b65bcb5722dc553f3c412ed4622137112defd2ff7df1b782"} Sep 08 13:19:20.733463 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.733419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerStarted","Data":"8427d7aa6986233c34016fffa4135f3ae4a91e28b96087af9e029e06be5ffc30"} Sep 08 13:19:20.734018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.733988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:20.736016 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.735959 2576 patch_prober.go:28] interesting pod/console-operator-85b454874b-8r56t container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.10:8443/readyz\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Sep 08 13:19:20.736122 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.736010 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.10:8443/readyz\": dial tcp 10.134.0.10:8443: connect: connection refused" Sep 08 13:19:20.736609 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.736582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" event={"ID":"ea82ef72-9c22-4d59-b670-05816aabfc9b","Type":"ContainerStarted","Data":"06ccd2211b7db49c069e47db70a3d34338b54ad64d15f01beb20dcff63e77676"} Sep 08 13:19:20.752744 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.752651 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" podStartSLOduration=1.7356419619999999 podStartE2EDuration="4.752633799s" totalImagesPullingTime="3.016991837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:20.75185611 +0000 UTC m=+138.959514229" watchObservedRunningTime="2026-09-08 13:19:20.752633799 +0000 UTC m=+138.960291889" Sep 08 13:19:20.774579 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.774524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podStartSLOduration=1.679291705 podStartE2EDuration="4.774509149s" totalImagesPullingTime="3.095217444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:20.774020896 +0000 UTC m=+138.981678993" watchObservedRunningTime="2026-09-08 13:19:20.774509149 +0000 UTC m=+138.982167244" Sep 08 13:19:20.791616 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.791561 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" podStartSLOduration=1.693238892 podStartE2EDuration="4.79154193s" totalImagesPullingTime="3.098303038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:20.790847906 +0000 UTC m=+138.998505998" watchObservedRunningTime="2026-09-08 13:19:20.79154193 +0000 UTC m=+138.999200074" Sep 08 13:19:20.819152 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:20.819106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:20.819355 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.819290 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 13:19:20.819429 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:20.819365 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls podName:71123832-4304-40ff-a6d3-5b2006237601 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:24.819344567 +0000 UTC m=+143.027002654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-gxszx" (UID: "71123832-4304-40ff-a6d3-5b2006237601") : secret "samples-operator-tls" not found Sep 08 13:19:21.072551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.072508 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zjjzt"] Sep 08 13:19:21.074905 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.074885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.077684 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.077661 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 13:19:21.077828 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.077670 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 13:19:21.077983 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.077968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 13:19:21.078041 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.077973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 13:19:21.078288 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.078271 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kdgsm\"" Sep 08 13:19:21.089521 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.089498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zjjzt"] Sep 08 13:19:21.222041 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.221996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.222041 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.222040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/80384edf-3336-482a-9854-48fe322ba4bd-crio-socket\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.222303 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.222062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/80384edf-3336-482a-9854-48fe322ba4bd-data-volume\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.222303 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.222137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrkbz\" (UniqueName: \"kubernetes.io/projected/80384edf-3336-482a-9854-48fe322ba4bd-kube-api-access-xrkbz\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.222303 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.222268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323014 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.322891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrkbz\" (UniqueName: \"kubernetes.io/projected/80384edf-3336-482a-9854-48fe322ba4bd-kube-api-access-xrkbz\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323014 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.322998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.323026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.323044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/80384edf-3336-482a-9854-48fe322ba4bd-crio-socket\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.323059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/80384edf-3336-482a-9854-48fe322ba4bd-data-volume\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.323139 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.323182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/80384edf-3336-482a-9854-48fe322ba4bd-crio-socket\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.323193 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:21.323231 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.323227 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:21.823205533 +0000 UTC m=+140.030863624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : configmap "kube-rbac-proxy" not found Sep 08 13:19:21.323581 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.323264 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:21.823246007 +0000 UTC m=+140.030904102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:21.323581 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.323383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/80384edf-3336-482a-9854-48fe322ba4bd-data-volume\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.335200 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.335172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrkbz\" (UniqueName: \"kubernetes.io/projected/80384edf-3336-482a-9854-48fe322ba4bd-kube-api-access-xrkbz\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.741266 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.741237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/0.log" Sep 08 13:19:21.741713 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.741276 2576 generic.go:356] "Generic (PLEG): container finished" podID="f743df81-995e-4b99-ab12-fe20e7f3439c" containerID="8427d7aa6986233c34016fffa4135f3ae4a91e28b96087af9e029e06be5ffc30" exitCode=255 Sep 08 13:19:21.741713 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.741313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerDied","Data":"8427d7aa6986233c34016fffa4135f3ae4a91e28b96087af9e029e06be5ffc30"} Sep 08 13:19:21.741713 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.741611 2576 scope.go:117] "RemoveContainer" containerID="8427d7aa6986233c34016fffa4135f3ae4a91e28b96087af9e029e06be5ffc30" Sep 08 13:19:21.829045 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.829001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.829255 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.829115 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:21.829255 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.829186 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:22.829167861 +0000 UTC m=+141.036825959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : configmap "kube-rbac-proxy" not found Sep 08 13:19:21.829392 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:21.829282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:21.829984 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.829960 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:21.830088 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:21.830016 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:22.829999884 +0000 UTC m=+141.037657974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:22.135439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.135339 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p"] Sep 08 13:19:22.137849 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.137824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" Sep 08 13:19:22.141023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.140995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s2k2n\"" Sep 08 13:19:22.141023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.140996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 08 13:19:22.141195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.141152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 08 13:19:22.149549 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.149524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p"] Sep 08 13:19:22.233524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.233488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbjn\" (UniqueName: \"kubernetes.io/projected/3186c3ca-393a-411e-b01f-74404ad06e9e-kube-api-access-lkbjn\") pod \"migrator-fdbb8fdff-qjk6p\" (UID: \"3186c3ca-393a-411e-b01f-74404ad06e9e\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" Sep 08 13:19:22.334412 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.334375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbjn\" (UniqueName: \"kubernetes.io/projected/3186c3ca-393a-411e-b01f-74404ad06e9e-kube-api-access-lkbjn\") pod \"migrator-fdbb8fdff-qjk6p\" (UID: \"3186c3ca-393a-411e-b01f-74404ad06e9e\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" Sep 08 13:19:22.344339 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.344309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbjn\" (UniqueName: \"kubernetes.io/projected/3186c3ca-393a-411e-b01f-74404ad06e9e-kube-api-access-lkbjn\") pod \"migrator-fdbb8fdff-qjk6p\" (UID: \"3186c3ca-393a-411e-b01f-74404ad06e9e\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" Sep 08 13:19:22.446979 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.446951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" Sep 08 13:19:22.567060 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.567023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:22.669831 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.669797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:22.716291 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.716198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p"] Sep 08 13:19:22.720745 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:22.720707 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3186c3ca_393a_411e_b01f_74404ad06e9e.slice/crio-c4fb4c053b35910404ae2f9538b5b20a6baa6bf594ed47f98d738cfa08cb68a5 WatchSource:0}: Error finding container c4fb4c053b35910404ae2f9538b5b20a6baa6bf594ed47f98d738cfa08cb68a5: Status 404 returned error can't find the container with id c4fb4c053b35910404ae2f9538b5b20a6baa6bf594ed47f98d738cfa08cb68a5 Sep 08 13:19:22.745733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.745704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/1.log" Sep 08 13:19:22.746165 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.746153 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/0.log" Sep 08 13:19:22.746206 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.746185 2576 generic.go:356] "Generic (PLEG): container finished" podID="f743df81-995e-4b99-ab12-fe20e7f3439c" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" exitCode=255 Sep 08 13:19:22.746267 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.746251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerDied","Data":"72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0"} Sep 08 13:19:22.746313 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.746302 2576 scope.go:117] "RemoveContainer" containerID="8427d7aa6986233c34016fffa4135f3ae4a91e28b96087af9e029e06be5ffc30" Sep 08 13:19:22.746514 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.746493 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:22.746706 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:22.746681 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:22.747725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.747563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" event={"ID":"3186c3ca-393a-411e-b01f-74404ad06e9e","Type":"ContainerStarted","Data":"c4fb4c053b35910404ae2f9538b5b20a6baa6bf594ed47f98d738cfa08cb68a5"} Sep 08 13:19:22.839941 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.839875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:22.840132 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:22.839990 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:22.840132 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:22.840056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:24.840039704 +0000 UTC m=+143.047697777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : configmap "kube-rbac-proxy" not found Sep 08 13:19:22.840254 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:22.840185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:22.840304 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:22.840275 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:22.840348 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:22.840323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:24.840309755 +0000 UTC m=+143.047967832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:23.115929 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.115826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:23.206158 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.206124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxnqs_64e8eca3-fd82-42d5-8969-1f100287f790/dns-node-resolver/0.log" Sep 08 13:19:23.211076 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.211036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:23.752246 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.752225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/1.log" Sep 08 13:19:23.752616 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.752597 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:23.752788 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:23.752767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:23.806018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:23.805994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjht9_1c56b6bb-eb24-48b2-8951-b3cb14b77bdc/node-ca/0.log" Sep 08 13:19:24.655155 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.655109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:24.655331 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.655263 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:24.655382 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.655331 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:32.655314349 +0000 UTC m=+150.862972423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:24.755775 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.755745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:24.756164 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.755863 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:24.756164 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.755927 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:32.755901799 +0000 UTC m=+150.963559873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:24.757932 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.757891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" event={"ID":"3186c3ca-393a-411e-b01f-74404ad06e9e","Type":"ContainerStarted","Data":"8f181ad87e890ea82de20c9b9475a8d2750a7a00cb8ee90ac7cc7999aaee466b"} Sep 08 13:19:24.758041 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.757954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" event={"ID":"3186c3ca-393a-411e-b01f-74404ad06e9e","Type":"ContainerStarted","Data":"b648bc78297693d174996ceae68193dc2420f7a8d1c8ef0dd94e2579aeaa81c4"} Sep 08 13:19:24.776526 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.776471 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-qjk6p" podStartSLOduration=1.749163587 podStartE2EDuration="2.776453529s" totalImagesPullingTime="1.027289942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:24.775857109 +0000 UTC m=+142.983515225" watchObservedRunningTime="2026-09-08 13:19:24.776453529 +0000 UTC m=+142.984111619" Sep 08 13:19:24.789327 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.789301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:24.856690 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.856642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:24.856857 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.856700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:24.856857 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.856773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:24.856857 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856799 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:24.856857 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856825 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 13:19:24.857023 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856864 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:24.857023 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls podName:71123832-4304-40ff-a6d3-5b2006237601 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:32.856865597 +0000 UTC m=+151.064523681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-gxszx" (UID: "71123832-4304-40ff-a6d3-5b2006237601") : secret "samples-operator-tls" not found Sep 08 13:19:24.857023 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856903 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:28.856896772 +0000 UTC m=+147.064554846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : configmap "kube-rbac-proxy" not found Sep 08 13:19:24.857023 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:24.856939 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:28.856929795 +0000 UTC m=+147.064587869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:24.889420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.889390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:24.956021 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:24.955990 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:25.005249 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:25.005217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcczb_7da4995c-f237-4fe6-96d7-22ef1e437484/serve-healthcheck-canary/0.log" Sep 08 13:19:27.246795 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:27.246750 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:27.247207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:27.247155 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:27.247321 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:27.247300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:27.586214 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:27.586122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.292962 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.292907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.393383 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.393335 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.472471 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.472431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.541370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.541333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.644005 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.643898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:28.891698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.891651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:28.891878 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:28.891709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:28.891878 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:28.891796 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 13:19:28.891878 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:28.891846 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:28.892002 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:28.891864 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:36.891848225 +0000 UTC m=+155.099506312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : configmap "kube-rbac-proxy" not found Sep 08 13:19:28.892002 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:28.891964 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:36.891943002 +0000 UTC m=+155.099601075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:29.390432 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:29.390389 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:29.985803 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:29.985765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:30.192023 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:30.191982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:30.734403 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:30.734351 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:30.734818 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:30.734801 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:30.735002 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:30.734982 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:30.930835 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:30.930797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:31.464198 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:31.464160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:31.565194 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:31.565151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:31.764464 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:31.764377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:31.843735 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:31.843699 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:32.194689 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.194649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:32.294900 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.294864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:32.596578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.596471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:32.723386 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.723348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:32.723548 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:32.723503 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:32.723589 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:32.723576 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls podName:cd8eb86c-a1e7-4e3b-835c-68b781053a3b nodeName:}" failed. No retries permitted until 2026-09-08 13:19:48.723560847 +0000 UTC m=+166.931218921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-4z9vw" (UID: "cd8eb86c-a1e7-4e3b-835c-68b781053a3b") : secret "cluster-monitoring-operator-tls" not found Sep 08 13:19:32.792762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.792722 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:32.823820 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.823775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:32.824046 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:32.823971 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 13:19:32.824124 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:32.824056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert podName:a08dca9c-b007-44e2-9183-a296400a0c8e nodeName:}" failed. No retries permitted until 2026-09-08 13:19:48.824033951 +0000 UTC m=+167.031692042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-vh49l" (UID: "a08dca9c-b007-44e2-9183-a296400a0c8e") : secret "networking-console-plugin-cert" not found Sep 08 13:19:32.924856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.924822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:32.927408 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.927379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71123832-4304-40ff-a6d3-5b2006237601-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-gxszx\" (UID: \"71123832-4304-40ff-a6d3-5b2006237601\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:32.957505 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:32.957460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" Sep 08 13:19:33.233406 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:33.233309 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx"] Sep 08 13:19:33.238690 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:33.238648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:33.787506 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:33.787465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" event={"ID":"71123832-4304-40ff-a6d3-5b2006237601","Type":"ContainerStarted","Data":"3a708de8a9a4db30e0468212584588894a292fe678d3a5ab60b81714451cc55a"} Sep 08 13:19:33.995170 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:33.995136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:34.288452 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:34.288417 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:34.388707 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:34.388672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:34.595475 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:34.595379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:34.862970 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:34.862843 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:35.006267 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:35.006230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:35.118257 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:35.118133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:35.984534 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:35.984507 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:36.389156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.389069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:36.801184 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.801147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" event={"ID":"71123832-4304-40ff-a6d3-5b2006237601","Type":"ContainerStarted","Data":"cf3132b21510676400410ddc8bd06ad6fc3bb7b0c9c2774e5c060648a44c0846"} Sep 08 13:19:36.801374 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.801201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" event={"ID":"71123832-4304-40ff-a6d3-5b2006237601","Type":"ContainerStarted","Data":"742304ac279698dcc80caf5bcd5b46f09c4fdf0daa0f2f566b3bfea93cb26646"} Sep 08 13:19:36.818046 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.817992 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-gxszx" podStartSLOduration=18.143465508 podStartE2EDuration="20.817976879s" totalImagesPullingTime="2.674511371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:36.817759492 +0000 UTC m=+155.025417588" watchObservedRunningTime="2026-09-08 13:19:36.817976879 +0000 UTC m=+155.025635027" Sep 08 13:19:36.959616 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.959562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:36.959616 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.959628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:36.959876 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:36.959690 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 13:19:36.959876 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:36.959756 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls podName:80384edf-3336-482a-9854-48fe322ba4bd nodeName:}" failed. No retries permitted until 2026-09-08 13:19:52.959740221 +0000 UTC m=+171.167398294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zjjzt" (UID: "80384edf-3336-482a-9854-48fe322ba4bd") : secret "insights-runtime-extractor-tls" not found Sep 08 13:19:36.960144 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:36.960124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/80384edf-3336-482a-9854-48fe322ba4bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:39.888112 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:39.888068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:39.989287 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:39.989254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:40.089337 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:40.089308 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:41.067157 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:41.067112 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pgmb8" podUID="452ad9d2-8123-4e69-b2ff-3cad4a9d1a68" Sep 08 13:19:41.817841 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:41.817808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgmb8" Sep 08 13:19:42.280652 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:42.280605 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b4sft" podUID="a788c6c8-4df9-4e8b-92b5-739e9d54723f" Sep 08 13:19:45.270105 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.270073 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:45.673574 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.673532 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c8894c59c-m7zwh"] Sep 08 13:19:45.677294 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.677270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.680342 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.680311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 13:19:45.680342 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.680311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 13:19:45.680557 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.680362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 13:19:45.681394 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.681357 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p6qj7\"" Sep 08 13:19:45.690170 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.690144 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8894c59c-m7zwh"] Sep 08 13:19:45.690572 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.690554 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 13:19:45.716005 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.715967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:45.817671 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.817635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:45.831196 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-ca-trust-extracted\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831196 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-trusted-ca\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xptdh\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-kube-api-access-xptdh\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-certificates\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-installation-pull-secrets\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-bound-sa-token\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831591 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-tls\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.831591 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.831488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-image-registry-private-configuration\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.833518 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.833492 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:19:45.833993 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.833976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/1.log" Sep 08 13:19:45.834087 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.834011 2576 generic.go:356] "Generic (PLEG): container finished" podID="f743df81-995e-4b99-ab12-fe20e7f3439c" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" exitCode=255 Sep 08 13:19:45.834087 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.834049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerDied","Data":"c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269"} Sep 08 13:19:45.834157 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.834099 2576 scope.go:117] "RemoveContainer" containerID="72b8c7404da2f549c143926bf245f000b163c5c570580d646ffa4412cb1d50b0" Sep 08 13:19:45.834469 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.834442 2576 scope.go:117] "RemoveContainer" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" Sep 08 13:19:45.834634 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:45.834616 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:45.932670 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.932560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xptdh\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-kube-api-access-xptdh\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.932904 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.932874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-certificates\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933022 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.932958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-installation-pull-secrets\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933022 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.932985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-bound-sa-token\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933022 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-tls\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-image-registry-private-configuration\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-ca-trust-extracted\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-trusted-ca\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933615 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-ca-trust-extracted\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.933751 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.933730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-certificates\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.934165 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.934145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-trusted-ca\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.935808 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.935784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-installation-pull-secrets\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.936050 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.936032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-image-registry-private-configuration\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.936231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.936210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-registry-tls\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.941460 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.941426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-bound-sa-token\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.941707 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.941686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xptdh\" (UniqueName: \"kubernetes.io/projected/2e0c3acd-b1bb-4d11-9abd-450b8acd45d5-kube-api-access-xptdh\") pod \"image-registry-7c8894c59c-m7zwh\" (UID: \"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5\") " pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:45.990591 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:45.990548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:46.033940 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.033874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:19:46.036283 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.036247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452ad9d2-8123-4e69-b2ff-3cad4a9d1a68-metrics-tls\") pod \"dns-default-pgmb8\" (UID: \"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68\") " pod="openshift-dns/dns-default-pgmb8" Sep 08 13:19:46.268581 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.268493 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8894c59c-m7zwh"] Sep 08 13:19:46.271521 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:46.271492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0c3acd_b1bb_4d11_9abd_450b8acd45d5.slice/crio-c304387ad57fedcf8539485d63d88c13657b62f25ecded74eb6960a83df8282b WatchSource:0}: Error finding container c304387ad57fedcf8539485d63d88c13657b62f25ecded74eb6960a83df8282b: Status 404 returned error can't find the container with id c304387ad57fedcf8539485d63d88c13657b62f25ecded74eb6960a83df8282b Sep 08 13:19:46.321159 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.321121 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8sm9m\"" Sep 08 13:19:46.328652 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.328613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgmb8" Sep 08 13:19:46.605657 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.605569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgmb8"] Sep 08 13:19:46.609850 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:46.609815 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452ad9d2_8123_4e69_b2ff_3cad4a9d1a68.slice/crio-dba027f063ee0693b254b0dff8c9f3e03c2d8404668aac5aeab60d9f5db9f5f7 WatchSource:0}: Error finding container dba027f063ee0693b254b0dff8c9f3e03c2d8404668aac5aeab60d9f5db9f5f7: Status 404 returned error can't find the container with id dba027f063ee0693b254b0dff8c9f3e03c2d8404668aac5aeab60d9f5db9f5f7 Sep 08 13:19:46.838879 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.838851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:19:46.840062 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.840030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgmb8" event={"ID":"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68","Type":"ContainerStarted","Data":"dba027f063ee0693b254b0dff8c9f3e03c2d8404668aac5aeab60d9f5db9f5f7"} Sep 08 13:19:46.841459 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.841431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" event={"ID":"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5","Type":"ContainerStarted","Data":"44b816e12ac9ee24e0c11e6bcc74bd23afedc061932a3ac1d29485d85a1de15c"} Sep 08 13:19:46.841574 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.841474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" event={"ID":"2e0c3acd-b1bb-4d11-9abd-450b8acd45d5","Type":"ContainerStarted","Data":"c304387ad57fedcf8539485d63d88c13657b62f25ecded74eb6960a83df8282b"} Sep 08 13:19:46.841617 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.841570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:19:46.872933 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:46.872805 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" podStartSLOduration=1.872786004 podStartE2EDuration="1.872786004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:46.872110326 +0000 UTC m=+165.079768432" watchObservedRunningTime="2026-09-08 13:19:46.872786004 +0000 UTC m=+165.080444100" Sep 08 13:19:47.246373 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:47.246328 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:47.246799 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:47.246778 2576 scope.go:117] "RemoveContainer" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" Sep 08 13:19:47.246994 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:47.246972 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:47.718326 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:47.718283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:47.796010 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:47.795967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:48.758601 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.758559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:48.761242 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.761203 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8eb86c-a1e7-4e3b-835c-68b781053a3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-4z9vw\" (UID: \"cd8eb86c-a1e7-4e3b-835c-68b781053a3b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:48.851075 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.851034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgmb8" event={"ID":"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68","Type":"ContainerStarted","Data":"0bacf5b0b4df1629eb60b0028bf50dbada5ddd00ec9563ebd67831dbab1f714d"} Sep 08 13:19:48.851281 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.851094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgmb8" event={"ID":"452ad9d2-8123-4e69-b2ff-3cad4a9d1a68","Type":"ContainerStarted","Data":"30b03723a20bb605c0c361a329197c725ddf27a46e601ecf26c1c9187bb1dfbf"} Sep 08 13:19:48.851281 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.851134 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pgmb8" Sep 08 13:19:48.859788 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.859747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:48.862322 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.862291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a08dca9c-b007-44e2-9183-a296400a0c8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-vh49l\" (UID: \"a08dca9c-b007-44e2-9183-a296400a0c8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:48.873320 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:48.873254 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pgmb8" podStartSLOduration=129.259999413 podStartE2EDuration="2m10.873235307s" totalImagesPullingTime="1.613235894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:48.872158898 +0000 UTC m=+167.079816995" watchObservedRunningTime="2026-09-08 13:19:48.873235307 +0000 UTC m=+167.080893407" Sep 08 13:19:49.032525 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.032429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" Sep 08 13:19:49.143432 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.143393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" Sep 08 13:19:49.308719 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.308609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw"] Sep 08 13:19:49.310829 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:49.310785 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8eb86c_a1e7_4e3b_835c_68b781053a3b.slice/crio-335fbd2f42a5af2a34f104e740200fa247883fc0ab576ca12524f7d7516dee7b WatchSource:0}: Error finding container 335fbd2f42a5af2a34f104e740200fa247883fc0ab576ca12524f7d7516dee7b: Status 404 returned error can't find the container with id 335fbd2f42a5af2a34f104e740200fa247883fc0ab576ca12524f7d7516dee7b Sep 08 13:19:49.417479 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.417342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-vh49l"] Sep 08 13:19:49.420029 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:49.419997 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08dca9c_b007_44e2_9183_a296400a0c8e.slice/crio-b86e9a8189e183eeac711e9a03f6970db6dc182494349383ccf2d5d100a58b31 WatchSource:0}: Error finding container b86e9a8189e183eeac711e9a03f6970db6dc182494349383ccf2d5d100a58b31: Status 404 returned error can't find the container with id b86e9a8189e183eeac711e9a03f6970db6dc182494349383ccf2d5d100a58b31 Sep 08 13:19:49.856002 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.855965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" event={"ID":"a08dca9c-b007-44e2-9183-a296400a0c8e","Type":"ContainerStarted","Data":"b86e9a8189e183eeac711e9a03f6970db6dc182494349383ccf2d5d100a58b31"} Sep 08 13:19:49.857141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:49.857115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" event={"ID":"cd8eb86c-a1e7-4e3b-835c-68b781053a3b","Type":"ContainerStarted","Data":"335fbd2f42a5af2a34f104e740200fa247883fc0ab576ca12524f7d7516dee7b"} Sep 08 13:19:50.734048 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:50.734000 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:19:50.734425 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:50.734409 2576 scope.go:117] "RemoveContainer" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" Sep 08 13:19:50.734590 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:19:50.734570 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:19:51.867332 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:51.867253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" event={"ID":"a08dca9c-b007-44e2-9183-a296400a0c8e","Type":"ContainerStarted","Data":"92a63ea61f360f8f764d21bf84797349ddf7530f3e6d98513cec823f653f6f78"} Sep 08 13:19:51.888477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:51.888413 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-vh49l" podStartSLOduration=34.24497608 podStartE2EDuration="35.888393665s" totalImagesPullingTime="1.643417585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:51.886365295 +0000 UTC m=+170.094023416" watchObservedRunningTime="2026-09-08 13:19:51.888393665 +0000 UTC m=+170.096051815" Sep 08 13:19:52.006471 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.006428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.075097 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.075040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.662311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.662211 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.756977 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.756934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.849501 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.849464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.872410 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.872376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" event={"ID":"cd8eb86c-a1e7-4e3b-835c-68b781053a3b","Type":"ContainerStarted","Data":"46ec74a983d7c52621b43965caa1227aeb86dcf6c92997ef9938b54d2432f1ef"} Sep 08 13:19:52.892705 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.892640 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-4z9vw" podStartSLOduration=33.902450145 podStartE2EDuration="36.892620361s" totalImagesPullingTime="2.990170216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:52.892225546 +0000 UTC m=+171.099883643" watchObservedRunningTime="2026-09-08 13:19:52.892620361 +0000 UTC m=+171.100278458" Sep 08 13:19:52.923442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.923399 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:52.993592 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.993549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:52.996035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:52.996009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/80384edf-3336-482a-9854-48fe322ba4bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjjzt\" (UID: \"80384edf-3336-482a-9854-48fe322ba4bd\") " pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:53.184035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:53.183899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zjjzt" Sep 08 13:19:53.270251 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:53.270213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:19:53.463275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:53.463190 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zjjzt"] Sep 08 13:19:53.466614 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:19:53.466579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80384edf_3336_482a_9854_48fe322ba4bd.slice/crio-339f889895f8aa97296895d56c9160f181f7bb34d6f26f133bdd599bb68ace80 WatchSource:0}: Error finding container 339f889895f8aa97296895d56c9160f181f7bb34d6f26f133bdd599bb68ace80: Status 404 returned error can't find the container with id 339f889895f8aa97296895d56c9160f181f7bb34d6f26f133bdd599bb68ace80 Sep 08 13:19:53.877733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:53.877645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjjzt" event={"ID":"80384edf-3336-482a-9854-48fe322ba4bd","Type":"ContainerStarted","Data":"fb265d031a1424deb004844b8c7bfa98e6a90c65b452c22b6e1716d6e9900a9c"} Sep 08 13:19:53.877733 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:53.877706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjjzt" event={"ID":"80384edf-3336-482a-9854-48fe322ba4bd","Type":"ContainerStarted","Data":"339f889895f8aa97296895d56c9160f181f7bb34d6f26f133bdd599bb68ace80"} Sep 08 13:19:54.476817 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:54.476783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:54.883454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:54.883414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjjzt" event={"ID":"80384edf-3336-482a-9854-48fe322ba4bd","Type":"ContainerStarted","Data":"8ffbe8a37de442a2adbccb6f5a4a86ed8bca21c742e425f81cafcbdcfddf5203"} Sep 08 13:19:55.882390 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:55.882342 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:55.957871 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:55.957775 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:56.343550 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:56.343517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:19:56.892875 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:56.892837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjjzt" event={"ID":"80384edf-3336-482a-9854-48fe322ba4bd","Type":"ContainerStarted","Data":"602d33b4b01b6bf66dfb69498cd61fe17fa4b9c5a96a60717f2e02450729c206"} Sep 08 13:19:56.916729 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:56.916675 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zjjzt" podStartSLOduration=33.475352474 podStartE2EDuration="35.916655724s" totalImagesPullingTime="2.44130325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:19:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:56.915377374 +0000 UTC m=+175.123035470" watchObservedRunningTime="2026-09-08 13:19:56.916655724 +0000 UTC m=+175.124313860" Sep 08 13:19:58.859996 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:19:58.859964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pgmb8" Sep 08 13:20:02.273156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:02.273120 2576 scope.go:117] "RemoveContainer" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" Sep 08 13:20:02.273934 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:20:02.273883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-8r56t_openshift-console-operator(f743df81-995e-4b99-ab12-fe20e7f3439c)\"" pod="openshift-console-operator/console-operator-85b454874b-8r56t" podUID="f743df81-995e-4b99-ab12-fe20e7f3439c" Sep 08 13:20:03.524490 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:03.524449 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.035234 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.035201 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.155439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.155400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.255145 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.255113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.321431 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.321346 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kzc54"] Sep 08 13:20:05.325655 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.325632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.328935 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.328886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 13:20:05.330606 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.330575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vhknt\"" Sep 08 13:20:05.330725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.330606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 13:20:05.330725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.330640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 13:20:05.330725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.330658 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 13:20:05.351675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.351642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.387869 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.387830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-wtmp\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.387869 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.387867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hk4\" (UniqueName: \"kubernetes.io/projected/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-kube-api-access-98hk4\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.387896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-textfile\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.387972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.388016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.388052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-sys\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.388089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-root\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.388105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-tls\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.388333 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.388245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-metrics-client-ca\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.421379 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.421341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.489626 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-root\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489626 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-tls\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-metrics-client-ca\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-root\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-wtmp\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hk4\" (UniqueName: \"kubernetes.io/projected/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-kube-api-access-98hk4\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-textfile\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.489860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-wtmp\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.490276 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-sys\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.490276 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.489965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-sys\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.490385 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.490297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-textfile\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.490568 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.490542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-metrics-client-ca\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.490640 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.490551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.492162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.492142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-tls\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.492219 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.492193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.498136 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.498111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hk4\" (UniqueName: \"kubernetes.io/projected/490c5ed6-642d-4607-a0fc-8d3813f0fb2d-kube-api-access-98hk4\") pod \"node-exporter-kzc54\" (UID: \"490c5ed6-642d-4607-a0fc-8d3813f0fb2d\") " pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.522492 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.522459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.623984 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.623882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.634814 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.634772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kzc54" Sep 08 13:20:05.646082 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:05.646046 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490c5ed6_642d_4607_a0fc_8d3813f0fb2d.slice/crio-54c682ca38e06385a9628fcf47f793315ee7db1e68d50956a246d6d0357c299c WatchSource:0}: Error finding container 54c682ca38e06385a9628fcf47f793315ee7db1e68d50956a246d6d0357c299c: Status 404 returned error can't find the container with id 54c682ca38e06385a9628fcf47f793315ee7db1e68d50956a246d6d0357c299c Sep 08 13:20:05.726585 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.726541 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.836152 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.836097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:05.927978 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.927943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzc54" event={"ID":"490c5ed6-642d-4607-a0fc-8d3813f0fb2d","Type":"ContainerStarted","Data":"54c682ca38e06385a9628fcf47f793315ee7db1e68d50956a246d6d0357c299c"} Sep 08 13:20:05.994955 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.994907 2576 patch_prober.go:28] interesting pod/image-registry-7c8894c59c-m7zwh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 08 13:20:05.995107 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:05.994985 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" podUID="2e0c3acd-b1bb-4d11-9abd-450b8acd45d5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:20:06.933870 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:06.933770 2576 generic.go:356] "Generic (PLEG): container finished" podID="490c5ed6-642d-4607-a0fc-8d3813f0fb2d" containerID="5b7cc30d3e70c3afc1b681a8e0c2cd1614a302708ac471a56cc7d7f1a4ea246a" exitCode=0 Sep 08 13:20:06.933870 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:06.933856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzc54" event={"ID":"490c5ed6-642d-4607-a0fc-8d3813f0fb2d","Type":"ContainerDied","Data":"5b7cc30d3e70c3afc1b681a8e0c2cd1614a302708ac471a56cc7d7f1a4ea246a"} Sep 08 13:20:07.374943 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.374838 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96b7994c4-4jcms"] Sep 08 13:20:07.378362 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.378343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.380949 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.380902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 13:20:07.381518 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381443 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6ps0rrltjifo8\"" Sep 08 13:20:07.381518 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381498 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 13:20:07.381701 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 13:20:07.381701 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 13:20:07.381701 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381688 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sq25f\"" Sep 08 13:20:07.381866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.381712 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 13:20:07.392352 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.392324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96b7994c4-4jcms"] Sep 08 13:20:07.454406 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.454373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:07.508265 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508371 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfd4\" (UniqueName: \"kubernetes.io/projected/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-kube-api-access-txfd4\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508371 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508371 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-grpc-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508474 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508474 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508536 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-metrics-client-ca\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.508536 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.508509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.556187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.556152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:07.609104 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609296 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609296 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-metrics-client-ca\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609296 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609296 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609296 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfd4\" (UniqueName: \"kubernetes.io/projected/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-kube-api-access-txfd4\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609552 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.609552 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.609329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-grpc-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.610150 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.610118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-metrics-client-ca\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.611990 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.611958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.612103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.612004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.612209 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.612191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.612318 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.612300 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.612436 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.612413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-thanos-querier-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.612477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.612463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-secret-grpc-tls\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.617258 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.617232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfd4\" (UniqueName: \"kubernetes.io/projected/1a25c1a7-22aa-49f3-9ca4-fed175f0eb09-kube-api-access-txfd4\") pod \"thanos-querier-96b7994c4-4jcms\" (UID: \"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09\") " pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.687429 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.687392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:07.850544 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.850515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c8894c59c-m7zwh" Sep 08 13:20:07.940451 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.940357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzc54" event={"ID":"490c5ed6-642d-4607-a0fc-8d3813f0fb2d","Type":"ContainerStarted","Data":"ce341e9f7c4976bc5d0fcc0cda265a9d00af7903ec3d7d65f60dc506b788661d"} Sep 08 13:20:07.940451 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.940424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzc54" event={"ID":"490c5ed6-642d-4607-a0fc-8d3813f0fb2d","Type":"ContainerStarted","Data":"07aaeef5329c4e9f3477ccfff6a440d54c67a969596ad5ff5a5aa2c6253899fe"} Sep 08 13:20:07.965589 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.965522 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kzc54" podStartSLOduration=1.867445294 podStartE2EDuration="2.965496856s" totalImagesPullingTime="1.031003221s" totalInitContainerRuntime="67.048341ms" isStatefulPod=true podCreationTimestamp="2026-09-08 13:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:07.964830225 +0000 UTC m=+186.172488331" watchObservedRunningTime="2026-09-08 13:20:07.965496856 +0000 UTC m=+186.173154953" Sep 08 13:20:07.973774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:07.973740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96b7994c4-4jcms"] Sep 08 13:20:07.977024 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:07.976987 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a25c1a7_22aa_49f3_9ca4_fed175f0eb09.slice/crio-acc7e1697e26b4e0b718c950f2fb598b4ab0e2d945f05daea73eb96be35be705 WatchSource:0}: Error finding container acc7e1697e26b4e0b718c950f2fb598b4ab0e2d945f05daea73eb96be35be705: Status 404 returned error can't find the container with id acc7e1697e26b4e0b718c950f2fb598b4ab0e2d945f05daea73eb96be35be705 Sep 08 13:20:08.006936 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.006881 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.107513 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.107473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.208231 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.208143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.308967 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.308935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.408666 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.408629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.604033 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.603939 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:08.948210 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:08.948168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"acc7e1697e26b4e0b718c950f2fb598b4ab0e2d945f05daea73eb96be35be705"} Sep 08 13:20:09.826613 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.826572 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4"] Sep 08 13:20:09.830029 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.830003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.834076 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834043 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6nh2n\"" Sep 08 13:20:09.834250 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 13:20:09.834314 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8condvr34591e\"" Sep 08 13:20:09.834384 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834187 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 13:20:09.834384 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834154 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 13:20:09.834584 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.834210 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 13:20:09.845818 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.845784 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4"] Sep 08 13:20:09.931441 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-client-certs\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931603 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931603 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77g7\" (UniqueName: \"kubernetes.io/projected/50009fb1-1f2a-440a-9932-b5096012f9a4-kube-api-access-z77g7\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931603 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-tls\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-client-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-metrics-server-audit-profiles\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:09.931845 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:09.931766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50009fb1-1f2a-440a-9932-b5096012f9a4-audit-log\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032350 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77g7\" (UniqueName: \"kubernetes.io/projected/50009fb1-1f2a-440a-9932-b5096012f9a4-kube-api-access-z77g7\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032350 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-tls\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-client-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-metrics-server-audit-profiles\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50009fb1-1f2a-440a-9932-b5096012f9a4-audit-log\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-client-certs\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.032856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.032531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.033127 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.033060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50009fb1-1f2a-440a-9932-b5096012f9a4-audit-log\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.033379 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.033351 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.033996 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.033949 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50009fb1-1f2a-440a-9932-b5096012f9a4-metrics-server-audit-profiles\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.036065 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.035994 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-client-ca-bundle\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.036525 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.036477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-tls\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.036525 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.036501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50009fb1-1f2a-440a-9932-b5096012f9a4-secret-metrics-server-client-certs\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.051420 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.051383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77g7\" (UniqueName: \"kubernetes.io/projected/50009fb1-1f2a-440a-9932-b5096012f9a4-kube-api-access-z77g7\") pod \"metrics-server-6c4c4d79d4-7gvq4\" (UID: \"50009fb1-1f2a-440a-9932-b5096012f9a4\") " pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.107155 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.107062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:10.142010 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.141970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:10.419624 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.419597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4"] Sep 08 13:20:10.518279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.518238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5"] Sep 08 13:20:10.522421 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.522395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.525977 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.525943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 08 13:20:10.526177 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.526157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 08 13:20:10.526312 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.526299 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 08 13:20:10.527358 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.527332 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 08 13:20:10.527472 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.527357 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7lt7q\"" Sep 08 13:20:10.527472 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.527415 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 08 13:20:10.532196 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.532169 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 08 13:20:10.541986 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.541950 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5"] Sep 08 13:20:10.637217 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-metrics-client-ca\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rpxb\" (UniqueName: \"kubernetes.io/projected/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-kube-api-access-6rpxb\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637404 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-federate-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637568 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637568 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-serving-certs-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.637568 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.637530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738368 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738368 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-metrics-client-ca\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rpxb\" (UniqueName: \"kubernetes.io/projected/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-kube-api-access-6rpxb\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-federate-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.738594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.738583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-serving-certs-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.739635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.739404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-serving-certs-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.739635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.739571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-metrics-client-ca\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.739809 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.739716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.741197 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.741106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:10.741821 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.741793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-telemeter-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.741950 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.741902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-federate-client-tls\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.742310 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.742286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.742543 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.742505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-secret-telemeter-client\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.749078 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.749047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rpxb\" (UniqueName: \"kubernetes.io/projected/7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b-kube-api-access-6rpxb\") pod \"telemeter-client-7f5f58b9cf-pv6f5\" (UID: \"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b\") " pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.834877 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.834836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" Sep 08 13:20:10.917500 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:10.917448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50009fb1_1f2a_440a_9932_b5096012f9a4.slice/crio-e93cb465669048c67e78ac8df952146db3a7cc7b1974d732b29df1275542717f WatchSource:0}: Error finding container e93cb465669048c67e78ac8df952146db3a7cc7b1974d732b29df1275542717f: Status 404 returned error can't find the container with id e93cb465669048c67e78ac8df952146db3a7cc7b1974d732b29df1275542717f Sep 08 13:20:10.958707 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:10.958665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" event={"ID":"50009fb1-1f2a-440a-9932-b5096012f9a4","Type":"ContainerStarted","Data":"e93cb465669048c67e78ac8df952146db3a7cc7b1974d732b29df1275542717f"} Sep 08 13:20:11.206092 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.206058 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5"] Sep 08 13:20:11.209084 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:11.209045 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7389c0b0_bd0e_40d4_b6ff_64ebf8a1664b.slice/crio-34afa8dea07532f3f9144b7c8669198978e77d53d1da26f4b871bf32cd774a9d WatchSource:0}: Error finding container 34afa8dea07532f3f9144b7c8669198978e77d53d1da26f4b871bf32cd774a9d: Status 404 returned error can't find the container with id 34afa8dea07532f3f9144b7c8669198978e77d53d1da26f4b871bf32cd774a9d Sep 08 13:20:11.552393 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.552356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:11.966103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.966062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"3f6cbc2b52ab17bb68e1cf7fd645b41669fc3ce83f3da2d6290d28f534c6dee4"} Sep 08 13:20:11.966298 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.966143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"bdb11765f3543d76b6412c6ebd2b81aa4d14b7670d46e40f301429a30c614f94"} Sep 08 13:20:11.966298 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.966182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"555b30c75a1f9cb78913d57d57048842c334cdbad7be0e83506adf58e9e5f7eb"} Sep 08 13:20:11.968155 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:11.968116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" event={"ID":"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b","Type":"ContainerStarted","Data":"34afa8dea07532f3f9144b7c8669198978e77d53d1da26f4b871bf32cd774a9d"} Sep 08 13:20:12.974001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:12.973955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" event={"ID":"50009fb1-1f2a-440a-9932-b5096012f9a4","Type":"ContainerStarted","Data":"e1721e5101cb722381888ac7e22ea68b489af37c55498eb39eab062d873bc158"} Sep 08 13:20:12.996034 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:12.995960 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" podStartSLOduration=2.383920004 podStartE2EDuration="3.995938621s" totalImagesPullingTime="1.612018617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:12.994192652 +0000 UTC m=+191.201850748" watchObservedRunningTime="2026-09-08 13:20:12.995938621 +0000 UTC m=+191.203596718" Sep 08 13:20:15.988727 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:15.988684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"3402d21c0ee90f99f9dae4440208c7237f0b87a680917beda2de88435417170d"} Sep 08 13:20:15.989195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:15.988770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"684f6ef1142f885199f9c158929ba4dd8082e626c212aef4a109e8d84dc0040e"} Sep 08 13:20:15.989195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:15.988814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" event={"ID":"1a25c1a7-22aa-49f3-9ca4-fed175f0eb09","Type":"ContainerStarted","Data":"8638f67f40d327df93c0ee3fca9e092ea1a03c6434141d80b73e3e62078b9be8"} Sep 08 13:20:15.989195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:15.988999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:16.014419 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.014353 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" podStartSLOduration=1.971949612 podStartE2EDuration="9.014308188s" totalImagesPullingTime="7.042358576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:16.012695328 +0000 UTC m=+194.220353474" watchObservedRunningTime="2026-09-08 13:20:16.014308188 +0000 UTC m=+194.221966285" Sep 08 13:20:16.277225 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.277200 2576 scope.go:117] "RemoveContainer" containerID="c7c9c323b33df12ca423e7f8ee6a8cbdb1aa6fb92de00dce45f3818d5df82269" Sep 08 13:20:16.975542 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.975508 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-q65r7"] Sep 08 13:20:16.979073 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.979045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:16.982621 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.982595 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 13:20:16.982768 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.982709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9wbmt\"" Sep 08 13:20:16.982876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.982861 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 13:20:16.988814 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.988786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-q65r7"] Sep 08 13:20:16.992359 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.992327 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:16.994375 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.994349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" event={"ID":"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b","Type":"ContainerStarted","Data":"151035e64e08570f4fb290d4f323f279d32e785945222b37a61ad3d8f8462773"} Sep 08 13:20:16.996460 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.996443 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:20:16.996583 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.996555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8r56t" event={"ID":"f743df81-995e-4b99-ab12-fe20e7f3439c","Type":"ContainerStarted","Data":"5b84187c73d5751a6bf8bb9a2e51298f46113491a538bd891a8517351816b158"} Sep 08 13:20:16.997038 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:16.997017 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:20:17.001787 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.001764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-8r56t" Sep 08 13:20:17.002725 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.002694 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96b7994c4-4jcms" Sep 08 13:20:17.094982 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.094942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7x2h\" (UniqueName: \"kubernetes.io/projected/ef6a973e-37ee-48e1-ae44-52b981f41ecd-kube-api-access-z7x2h\") pod \"downloads-85d98c998f-q65r7\" (UID: \"ef6a973e-37ee-48e1-ae44-52b981f41ecd\") " pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:17.101129 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.101100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:17.193021 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.192983 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:17.195900 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.195872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7x2h\" (UniqueName: \"kubernetes.io/projected/ef6a973e-37ee-48e1-ae44-52b981f41ecd-kube-api-access-z7x2h\") pod \"downloads-85d98c998f-q65r7\" (UID: \"ef6a973e-37ee-48e1-ae44-52b981f41ecd\") " pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:17.212345 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.212311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7x2h\" (UniqueName: \"kubernetes.io/projected/ef6a973e-37ee-48e1-ae44-52b981f41ecd-kube-api-access-z7x2h\") pod \"downloads-85d98c998f-q65r7\" (UID: \"ef6a973e-37ee-48e1-ae44-52b981f41ecd\") " pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:17.288822 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.288708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:17.295269 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.295218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:17.564642 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:17.564559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-q65r7"] Sep 08 13:20:17.567284 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:17.567252 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6a973e_37ee_48e1_ae44_52b981f41ecd.slice/crio-5df73701f84eb4091c6586413252ec1c3ef2a805f4432aa03e388b34cd24c531 WatchSource:0}: Error finding container 5df73701f84eb4091c6586413252ec1c3ef2a805f4432aa03e388b34cd24c531: Status 404 returned error can't find the container with id 5df73701f84eb4091c6586413252ec1c3ef2a805f4432aa03e388b34cd24c531 Sep 08 13:20:18.002313 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:18.002274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-q65r7" event={"ID":"ef6a973e-37ee-48e1-ae44-52b981f41ecd","Type":"ContainerStarted","Data":"5df73701f84eb4091c6586413252ec1c3ef2a805f4432aa03e388b34cd24c531"} Sep 08 13:20:20.940955 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:20.940876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:21.041266 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:21.041215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:22.022017 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:22.021977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" event={"ID":"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b","Type":"ContainerStarted","Data":"bcb8c340f7306dc7a73bb879829dd14c865c6b075345d4a34362a7f6fc853ebe"} Sep 08 13:20:22.022461 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:22.022050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" event={"ID":"7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b","Type":"ContainerStarted","Data":"89a84a772dbf38d497573617437d9953ef14019a81dbf4c1b9837c6dd20cb8ec"} Sep 08 13:20:22.048445 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:22.048380 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f5f58b9cf-pv6f5" podStartSLOduration=2.321893347 podStartE2EDuration="12.048358311s" totalImagesPullingTime="9.726464964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:22.046469145 +0000 UTC m=+200.254127272" watchObservedRunningTime="2026-09-08 13:20:22.048358311 +0000 UTC m=+200.256016406" Sep 08 13:20:24.896289 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:24.896237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:24.996994 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:24.996944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:25.102718 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:25.102679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:26.492029 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.491980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:26.552495 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.552452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:26.966902 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.966863 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:20:26.970444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.970418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:26.974140 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2qmt4\"" Sep 08 13:20:26.974295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 13:20:26.974295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974109 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 13:20:26.974295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 13:20:26.974295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 13:20:26.974295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.974110 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 13:20:26.984000 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:26.983890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:20:27.094335 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.094507 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.094507 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.094587 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.094587 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582js\" (UniqueName: \"kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.094587 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.094569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.195759 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.195714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.195976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.195805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.195976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.195846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.195976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.195866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.196141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.196016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.196141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.196061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582js\" (UniqueName: \"kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.196706 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.196650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.196833 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.196706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.196833 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.196714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.199016 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.198990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.199264 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.199235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.205146 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.205113 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582js\" (UniqueName: \"kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js\") pod \"console-79bfb874f7-2j454\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.280730 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.280634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:27.569234 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:27.569204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:20:27.571754 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:27.571720 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ebea4e_6041_428f_8107_1adcb49a49cb.slice/crio-454ce467d8ae814eaa0480661445e9a6aeca3a1f67e17a542c762114cb93ae4a WatchSource:0}: Error finding container 454ce467d8ae814eaa0480661445e9a6aeca3a1f67e17a542c762114cb93ae4a: Status 404 returned error can't find the container with id 454ce467d8ae814eaa0480661445e9a6aeca3a1f67e17a542c762114cb93ae4a Sep 08 13:20:28.054179 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.054139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfb874f7-2j454" event={"ID":"57ebea4e-6041-428f-8107-1adcb49a49cb","Type":"ContainerStarted","Data":"454ce467d8ae814eaa0480661445e9a6aeca3a1f67e17a542c762114cb93ae4a"} Sep 08 13:20:28.426978 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.426927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:28.488346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.488310 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:28.712206 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.712109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:28.810684 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.810648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:28.911783 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:28.911729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:30.142536 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:30.142498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:30.143003 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:30.142621 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:32.714592 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:32.714547 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:32.807413 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:32.807370 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:35.476701 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.476664 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:20:35.482367 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.482335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.491346 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.491316 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 13:20:35.500945 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.500873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:20:35.575423 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575630 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575630 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575630 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575773 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzrn\" (UniqueName: \"kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575773 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.575773 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.575768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676504 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzrn\" (UniqueName: \"kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676504 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.676774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.676713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.677418 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.677384 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.677624 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.677599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.677704 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.677654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.677704 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.677680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.679679 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.679649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.679796 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.679739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.686640 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.686607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzrn\" (UniqueName: \"kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn\") pod \"console-884984df5-g769d\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:35.796541 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:35.796448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:36.077551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.077412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:20:36.081657 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:20:36.081619 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685c12da_b671_4658_9226_701af7c980e8.slice/crio-0685328f63237ea721d7b0dfc35d867698eeeea632efdf6bd65a226a5e680ba6 WatchSource:0}: Error finding container 0685328f63237ea721d7b0dfc35d867698eeeea632efdf6bd65a226a5e680ba6: Status 404 returned error can't find the container with id 0685328f63237ea721d7b0dfc35d867698eeeea632efdf6bd65a226a5e680ba6 Sep 08 13:20:36.095789 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.095733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884984df5-g769d" event={"ID":"685c12da-b671-4658-9226-701af7c980e8","Type":"ContainerStarted","Data":"0685328f63237ea721d7b0dfc35d867698eeeea632efdf6bd65a226a5e680ba6"} Sep 08 13:20:36.098288 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.098243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-q65r7" event={"ID":"ef6a973e-37ee-48e1-ae44-52b981f41ecd","Type":"ContainerStarted","Data":"5be07fb2fccd19051936061092e4702c9ced42a7112bbf5797adaed33f1e2c1d"} Sep 08 13:20:36.098744 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.098710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:36.100467 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.100264 2576 patch_prober.go:28] interesting pod/downloads-85d98c998f-q65r7 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.22:8080/\": dial tcp 10.134.0.22:8080: connect: connection refused" start-of-body= Sep 08 13:20:36.100467 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.100331 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-q65r7" podUID="ef6a973e-37ee-48e1-ae44-52b981f41ecd" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.22:8080/\": dial tcp 10.134.0.22:8080: connect: connection refused" Sep 08 13:20:36.119325 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.119256 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-q65r7" podStartSLOduration=1.855078692 podStartE2EDuration="20.119235573s" totalImagesPullingTime="18.264156881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:36.118514227 +0000 UTC m=+214.326172344" watchObservedRunningTime="2026-09-08 13:20:36.119235573 +0000 UTC m=+214.326893668" Sep 08 13:20:36.743258 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.743141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:36.840958 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.840877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:36.940148 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:36.940042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:37.043288 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:37.043131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:37.120093 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:37.120060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-q65r7" Sep 08 13:20:37.241865 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:37.241687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:40.120789 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:40.120738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfb874f7-2j454" event={"ID":"57ebea4e-6041-428f-8107-1adcb49a49cb","Type":"ContainerStarted","Data":"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32"} Sep 08 13:20:40.122613 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:40.122580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884984df5-g769d" event={"ID":"685c12da-b671-4658-9226-701af7c980e8","Type":"ContainerStarted","Data":"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a"} Sep 08 13:20:40.142088 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:40.142030 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79bfb874f7-2j454" podStartSLOduration=2.053441285 podStartE2EDuration="14.142008641s" totalImagesPullingTime="12.088567356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:40.140499436 +0000 UTC m=+218.348157632" watchObservedRunningTime="2026-09-08 13:20:40.142008641 +0000 UTC m=+218.349666739" Sep 08 13:20:41.638944 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:41.638895 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgmb8_452ad9d2-8123-4e69-b2ff-3cad4a9d1a68/dns/0.log" Sep 08 13:20:41.645524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:41.645440 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgmb8_452ad9d2-8123-4e69-b2ff-3cad4a9d1a68/kube-rbac-proxy/0.log" Sep 08 13:20:42.120703 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:42.120671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxnqs_64e8eca3-fd82-42d5-8969-1f100287f790/dns-node-resolver/0.log" Sep 08 13:20:42.134476 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:42.134431 2576 generic.go:356] "Generic (PLEG): container finished" podID="e37e2b15-db0c-4ed6-a57e-50981ebd6199" containerID="73ca0acc72690795b65bcb5722dc553f3c412ed4622137112defd2ff7df1b782" exitCode=0 Sep 08 13:20:42.134658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:42.134511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" event={"ID":"e37e2b15-db0c-4ed6-a57e-50981ebd6199","Type":"ContainerDied","Data":"73ca0acc72690795b65bcb5722dc553f3c412ed4622137112defd2ff7df1b782"} Sep 08 13:20:42.134964 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:42.134943 2576 scope.go:117] "RemoveContainer" containerID="73ca0acc72690795b65bcb5722dc553f3c412ed4622137112defd2ff7df1b782" Sep 08 13:20:42.154233 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:42.154176 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-884984df5-g769d" podStartSLOduration=3.424979572 podStartE2EDuration="7.154151504s" totalImagesPullingTime="3.729171932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:40.160310521 +0000 UTC m=+218.367968639" watchObservedRunningTime="2026-09-08 13:20:42.154151504 +0000 UTC m=+220.361809601" Sep 08 13:20:43.141830 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:43.141732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgkt6" event={"ID":"e37e2b15-db0c-4ed6-a57e-50981ebd6199","Type":"ContainerStarted","Data":"64320706b34ceeb5520a56d97a69cd673bbda6e6e621da50bf01f9d48bff2cc3"} Sep 08 13:20:44.886006 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:44.885967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:44.956663 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:44.956617 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:45.797651 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:45.797609 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:45.797823 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:45.797693 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:45.802601 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:45.802574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:46.160413 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:46.160325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-884984df5-g769d" Sep 08 13:20:46.247519 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:46.247484 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:20:47.281340 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:47.281293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:20:47.701542 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:47.701498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:47.765627 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:47.765591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:48.511567 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:48.511526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:48.588960 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:48.588902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:49.098233 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:49.098196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:49.198998 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:49.198960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:50.147738 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:50.147710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:50.151591 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:50.151570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c4c4d79d4-7gvq4" Sep 08 13:20:50.946600 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:50.946562 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:51.049210 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:51.049167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:20:52.182886 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:52.182844 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea82ef72-9c22-4d59-b670-05816aabfc9b" containerID="06ccd2211b7db49c069e47db70a3d34338b54ad64d15f01beb20dcff63e77676" exitCode=0 Sep 08 13:20:52.183370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:52.182927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" event={"ID":"ea82ef72-9c22-4d59-b670-05816aabfc9b","Type":"ContainerDied","Data":"06ccd2211b7db49c069e47db70a3d34338b54ad64d15f01beb20dcff63e77676"} Sep 08 13:20:52.183370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:52.183290 2576 scope.go:117] "RemoveContainer" containerID="06ccd2211b7db49c069e47db70a3d34338b54ad64d15f01beb20dcff63e77676" Sep 08 13:20:53.190884 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:20:53.190771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-b5xx6" event={"ID":"ea82ef72-9c22-4d59-b670-05816aabfc9b","Type":"ContainerStarted","Data":"b8ad4ecd0e7dac548cfd2cb17838d2ca413f71e0354df01cffc5f8dedd1c8782"} Sep 08 13:21:02.709840 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:02.709797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:02.810485 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:02.810446 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:11.267943 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.267867 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79bfb874f7-2j454" podUID="57ebea4e-6041-428f-8107-1adcb49a49cb" containerName="console" containerID="cri-o://5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32" gracePeriod=15 Sep 08 13:21:11.568615 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.568578 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:21:11.727877 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.727837 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.727890 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.727967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-582js\" (UniqueName: \"kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.727992 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.728021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728103 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.728070 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert\") pod \"57ebea4e-6041-428f-8107-1adcb49a49cb\" (UID: \"57ebea4e-6041-428f-8107-1adcb49a49cb\") " Sep 08 13:21:11.728444 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.728415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:11.728514 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.728483 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config" (OuterVolumeSpecName: "console-config") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:11.728570 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.728541 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:21:11.730259 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.730225 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:11.730366 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.730268 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js" (OuterVolumeSpecName: "kube-api-access-582js") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "kube-api-access-582js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:21:11.730366 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.730289 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57ebea4e-6041-428f-8107-1adcb49a49cb" (UID: "57ebea4e-6041-428f-8107-1adcb49a49cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829398 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-oauth-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829432 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-service-ca\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829442 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-582js\" (UniqueName: \"kubernetes.io/projected/57ebea4e-6041-428f-8107-1adcb49a49cb-kube-api-access-582js\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829451 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57ebea4e-6041-428f-8107-1adcb49a49cb-console-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829459 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-console-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:11.829491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:11.829468 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57ebea4e-6041-428f-8107-1adcb49a49cb-oauth-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:21:12.274497 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.274464 2576 generic.go:356] "Generic (PLEG): container finished" podID="57ebea4e-6041-428f-8107-1adcb49a49cb" containerID="5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32" exitCode=0 Sep 08 13:21:12.274880 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.274533 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bfb874f7-2j454" Sep 08 13:21:12.275896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.275857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfb874f7-2j454" event={"ID":"57ebea4e-6041-428f-8107-1adcb49a49cb","Type":"ContainerDied","Data":"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32"} Sep 08 13:21:12.276048 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.275937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bfb874f7-2j454" event={"ID":"57ebea4e-6041-428f-8107-1adcb49a49cb","Type":"ContainerDied","Data":"454ce467d8ae814eaa0480661445e9a6aeca3a1f67e17a542c762114cb93ae4a"} Sep 08 13:21:12.276048 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.275974 2576 scope.go:117] "RemoveContainer" containerID="5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32" Sep 08 13:21:12.287806 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.287784 2576 scope.go:117] "RemoveContainer" containerID="5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32" Sep 08 13:21:12.288165 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:21:12.288142 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32\": container with ID starting with 5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32 not found: ID does not exist" containerID="5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32" Sep 08 13:21:12.288243 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.288173 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32"} err="failed to get container status \"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32\": rpc error: code = NotFound desc = could not find container \"5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32\": container with ID starting with 5eea406ec2607863df98bc1cc9cf3bd1706aee94d67d9001446323942a42af32 not found: ID does not exist" Sep 08 13:21:12.308969 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.308930 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:21:12.313370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:12.313338 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79bfb874f7-2j454"] Sep 08 13:21:14.046283 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.046244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:21:14.048612 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.048584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a788c6c8-4df9-4e8b-92b5-739e9d54723f-metrics-certs\") pod \"network-metrics-daemon-b4sft\" (UID: \"a788c6c8-4df9-4e8b-92b5-739e9d54723f\") " pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:21:14.273884 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.273848 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p8w4\"" Sep 08 13:21:14.275384 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.275356 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ebea4e-6041-428f-8107-1adcb49a49cb" path="/var/lib/kubelet/pods/57ebea4e-6041-428f-8107-1adcb49a49cb/volumes" Sep 08 13:21:14.280988 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.280961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4sft" Sep 08 13:21:14.591070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:14.588521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4sft"] Sep 08 13:21:14.593019 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:21:14.592980 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda788c6c8_4df9_4e8b_92b5_739e9d54723f.slice/crio-c7b0f82a2dc29adbbf262cba62f2fb3a6b5f16843fdee500c7f50d378ceba628 WatchSource:0}: Error finding container c7b0f82a2dc29adbbf262cba62f2fb3a6b5f16843fdee500c7f50d378ceba628: Status 404 returned error can't find the container with id c7b0f82a2dc29adbbf262cba62f2fb3a6b5f16843fdee500c7f50d378ceba628 Sep 08 13:21:15.289623 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:15.289578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4sft" event={"ID":"a788c6c8-4df9-4e8b-92b5-739e9d54723f","Type":"ContainerStarted","Data":"c7b0f82a2dc29adbbf262cba62f2fb3a6b5f16843fdee500c7f50d378ceba628"} Sep 08 13:21:16.296215 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:16.296110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4sft" event={"ID":"a788c6c8-4df9-4e8b-92b5-739e9d54723f","Type":"ContainerStarted","Data":"3031d2d744afeb6e04bdad2dc617ff06f6b95c8342f151bf8e78bd76094ce69e"} Sep 08 13:21:16.940187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:16.940153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:17.302763 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:17.302658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4sft" event={"ID":"a788c6c8-4df9-4e8b-92b5-739e9d54723f","Type":"ContainerStarted","Data":"f9d7e17ddc5aec531c563944b33210edc7c7ab93f2d29857b0ed2e91438bb50c"} Sep 08 13:21:17.322378 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:17.322311 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b4sft" podStartSLOduration=253.888813625 podStartE2EDuration="4m15.322290573s" totalImagesPullingTime="1.433476948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:17.32035445 +0000 UTC m=+255.528012558" watchObservedRunningTime="2026-09-08 13:21:17.322290573 +0000 UTC m=+255.529948669" Sep 08 13:21:17.421094 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:17.421056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:17.485089 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:17.485044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:21.550540 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:21.550494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:21.614266 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:21.614226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:27.348896 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.348799 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:21:27.349402 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.349321 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ebea4e-6041-428f-8107-1adcb49a49cb" containerName="console" Sep 08 13:21:27.349402 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.349345 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ebea4e-6041-428f-8107-1adcb49a49cb" containerName="console" Sep 08 13:21:27.349505 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.349429 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ebea4e-6041-428f-8107-1adcb49a49cb" containerName="console" Sep 08 13:21:27.352199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.352174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.373125 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.373091 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:21:27.427148 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.427106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:27.464831 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.464786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.464831 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.464837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.465115 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.464862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.465115 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.464979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfx9k\" (UniqueName: \"kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.465115 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.465068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.465115 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.465097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.465257 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.465117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.565594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.565801 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.565801 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.565801 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfx9k\" (UniqueName: \"kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.565801 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566045 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566045 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.565849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566618 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.566593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566618 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.566610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.566624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.566866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.566815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.568228 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.568207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.568431 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.568409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.575291 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.575263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfx9k\" (UniqueName: \"kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k\") pod \"console-5bb99fffd6-m7fkm\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.662171 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.662076 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:27.937815 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:27.937788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:21:27.940475 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:21:27.940447 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda976dd28_c284_42a9_94d8_d8cd7e13fc37.slice/crio-a98fc694821b520156a60aa68658b0d5d12b85224445d23b14f828800d41b0d1 WatchSource:0}: Error finding container a98fc694821b520156a60aa68658b0d5d12b85224445d23b14f828800d41b0d1: Status 404 returned error can't find the container with id a98fc694821b520156a60aa68658b0d5d12b85224445d23b14f828800d41b0d1 Sep 08 13:21:28.353996 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:28.353882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb99fffd6-m7fkm" event={"ID":"a976dd28-c284-42a9-94d8-d8cd7e13fc37","Type":"ContainerStarted","Data":"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92"} Sep 08 13:21:28.353996 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:28.353952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb99fffd6-m7fkm" event={"ID":"a976dd28-c284-42a9-94d8-d8cd7e13fc37","Type":"ContainerStarted","Data":"a98fc694821b520156a60aa68658b0d5d12b85224445d23b14f828800d41b0d1"} Sep 08 13:21:28.374573 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:28.374520 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bb99fffd6-m7fkm" podStartSLOduration=1.3745033119999999 podStartE2EDuration="1.374503312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:28.374246867 +0000 UTC m=+266.581904995" watchObservedRunningTime="2026-09-08 13:21:28.374503312 +0000 UTC m=+266.582161409" Sep 08 13:21:28.924543 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:28.924500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:28.994197 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:28.994159 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:29.203580 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:29.203492 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:29.305096 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:29.305064 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:32.732109 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:32.732068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:32.832153 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:32.832118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:32.909039 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:32.909003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:37.663237 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:37.663199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:37.663654 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:37.663306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:37.668395 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:37.668364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:38.401014 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:38.400983 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:21:38.455090 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:38.455046 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:21:38.575532 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:38.575491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:38.680844 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:38.680808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:41.818707 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:41.818669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:51.751626 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:51.751587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:21:54.954300 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:21:54.954262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:22:02.144353 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:02.144323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:22:02.147774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:02.147743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:22:02.153530 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:02.153506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:22:02.156334 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:02.156308 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:22:02.157964 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:02.157941 2576 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 13:22:03.477818 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.477778 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-884984df5-g769d" podUID="685c12da-b671-4658-9226-701af7c980e8" containerName="console" containerID="cri-o://eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a" gracePeriod=15 Sep 08 13:22:03.736866 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.736799 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884984df5-g769d" Sep 08 13:22:03.777156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.777123 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.777335 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.777164 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hzrn\" (UniqueName: \"kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.777335 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.777209 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.779443 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.779403 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn" (OuterVolumeSpecName: "kube-api-access-9hzrn") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "kube-api-access-9hzrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:22:03.779443 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.779422 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:22:03.779443 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.779408 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:22:03.877795 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.877743 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.877795 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.877792 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.878034 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.877825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.878034 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.877857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert\") pod \"685c12da-b671-4658-9226-701af7c980e8\" (UID: \"685c12da-b671-4658-9226-701af7c980e8\") " Sep 08 13:22:03.878165 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878147 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-oauth-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.878201 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878174 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/685c12da-b671-4658-9226-701af7c980e8-console-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.878201 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878181 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:22:03.878265 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878192 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hzrn\" (UniqueName: \"kubernetes.io/projected/685c12da-b671-4658-9226-701af7c980e8-kube-api-access-9hzrn\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.878297 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878279 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config" (OuterVolumeSpecName: "console-config") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:22:03.878330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878292 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:22:03.878330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.878301 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "685c12da-b671-4658-9226-701af7c980e8" (UID: "685c12da-b671-4658-9226-701af7c980e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:22:03.978966 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.978902 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-console-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.978966 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.978962 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-oauth-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.978966 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.978972 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-service-ca\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:03.979187 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:03.978983 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685c12da-b671-4658-9226-701af7c980e8-trusted-ca-bundle\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:22:04.510141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.510107 2576 generic.go:356] "Generic (PLEG): container finished" podID="685c12da-b671-4658-9226-701af7c980e8" containerID="eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a" exitCode=0 Sep 08 13:22:04.510611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.510152 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884984df5-g769d" Sep 08 13:22:04.510611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.510199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884984df5-g769d" event={"ID":"685c12da-b671-4658-9226-701af7c980e8","Type":"ContainerDied","Data":"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a"} Sep 08 13:22:04.510611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.510265 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884984df5-g769d" event={"ID":"685c12da-b671-4658-9226-701af7c980e8","Type":"ContainerDied","Data":"0685328f63237ea721d7b0dfc35d867698eeeea632efdf6bd65a226a5e680ba6"} Sep 08 13:22:04.510611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.510297 2576 scope.go:117] "RemoveContainer" containerID="eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a" Sep 08 13:22:04.520576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.520531 2576 scope.go:117] "RemoveContainer" containerID="eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a" Sep 08 13:22:04.521030 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:22:04.521001 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a\": container with ID starting with eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a not found: ID does not exist" containerID="eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a" Sep 08 13:22:04.521136 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.521034 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a"} err="failed to get container status \"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a\": rpc error: code = NotFound desc = could not find container \"eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a\": container with ID starting with eccb0f81934b6630852e6149e156974633ee64bf74f799b83d0fbc4a0605f44a not found: ID does not exist" Sep 08 13:22:04.528724 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.528688 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:22:04.532338 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:04.532309 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-884984df5-g769d"] Sep 08 13:22:06.275401 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:06.275363 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685c12da-b671-4658-9226-701af7c980e8" path="/var/lib/kubelet/pods/685c12da-b671-4658-9226-701af7c980e8/volumes" Sep 08 13:22:11.689720 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:11.689678 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:22:14.846678 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:14.846637 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:22:49.075709 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:22:49.075667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:30.078757 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:30.078714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:31.398126 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.398080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:31.447100 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.447069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk"] Sep 08 13:23:31.447459 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.447442 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685c12da-b671-4658-9226-701af7c980e8" containerName="console" Sep 08 13:23:31.447537 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.447462 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="685c12da-b671-4658-9226-701af7c980e8" containerName="console" Sep 08 13:23:31.447594 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.447548 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="685c12da-b671-4658-9226-701af7c980e8" containerName="console" Sep 08 13:23:31.449471 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.449451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.452506 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.452486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 08 13:23:31.452506 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.452498 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsrl8\"" Sep 08 13:23:31.453408 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.453385 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 08 13:23:31.462612 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.462586 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk"] Sep 08 13:23:31.514621 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.514576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:31.528726 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.528687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.528849 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.528776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v8v\" (UniqueName: \"kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.528849 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.528802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.629370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.629333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.629551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.629413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v8v\" (UniqueName: \"kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.629551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.629434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.629836 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.629812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.629872 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.629814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.639666 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.639639 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v8v\" (UniqueName: \"kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:31.758811 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:31.758772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:32.029968 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:32.029941 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk"] Sep 08 13:23:32.032390 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:23:32.032362 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d48380d_8eb4_4be0_8c12_7e1ec0f0142e.slice/crio-1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221 WatchSource:0}: Error finding container 1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221: Status 404 returned error can't find the container with id 1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221 Sep 08 13:23:32.034603 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:32.034581 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 13:23:32.869459 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:32.869415 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" event={"ID":"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e","Type":"ContainerStarted","Data":"1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221"} Sep 08 13:23:38.900708 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:38.900672 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerID="e5b91e89f1333f4c62951eae7af6d089124f1eddda466078e2d42fbd2e61c293" exitCode=0 Sep 08 13:23:38.901132 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:38.900759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" event={"ID":"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e","Type":"ContainerDied","Data":"e5b91e89f1333f4c62951eae7af6d089124f1eddda466078e2d42fbd2e61c293"} Sep 08 13:23:41.915778 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:41.915740 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerID="b5678ef28bd27a0ed4e5830b66355d16dd211c3b733a97466671e88fa1e4eb01" exitCode=0 Sep 08 13:23:41.916161 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:41.915830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" event={"ID":"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e","Type":"ContainerDied","Data":"b5678ef28bd27a0ed4e5830b66355d16dd211c3b733a97466671e88fa1e4eb01"} Sep 08 13:23:48.952664 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:48.952630 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerID="314626e0062754f7f80a52f50beae3df38832c2c601e58f2a1f8df07402d39ef" exitCode=0 Sep 08 13:23:48.953147 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:48.952687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" event={"ID":"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e","Type":"ContainerDied","Data":"314626e0062754f7f80a52f50beae3df38832c2c601e58f2a1f8df07402d39ef"} Sep 08 13:23:50.090456 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.090427 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:50.197484 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.197446 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util\") pod \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " Sep 08 13:23:50.197484 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.197491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6v8v\" (UniqueName: \"kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v\") pod \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " Sep 08 13:23:50.197702 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.197541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle\") pod \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\" (UID: \"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e\") " Sep 08 13:23:50.198257 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.198225 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle" (OuterVolumeSpecName: "bundle") pod "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" (UID: "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 13:23:50.199876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.199838 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v" (OuterVolumeSpecName: "kube-api-access-b6v8v") pod "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" (UID: "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e"). InnerVolumeSpecName "kube-api-access-b6v8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:23:50.201613 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.201591 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util" (OuterVolumeSpecName: "util") pod "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" (UID: "5d48380d-8eb4-4be0-8c12-7e1ec0f0142e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 13:23:50.298123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.298085 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-bundle\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:23:50.298123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.298116 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-util\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:23:50.298123 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.298127 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6v8v\" (UniqueName: \"kubernetes.io/projected/5d48380d-8eb4-4be0-8c12-7e1ec0f0142e-kube-api-access-b6v8v\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:23:50.962545 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.962513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" event={"ID":"5d48380d-8eb4-4be0-8c12-7e1ec0f0142e","Type":"ContainerDied","Data":"1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221"} Sep 08 13:23:50.962545 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.962535 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1agmvkk" Sep 08 13:23:50.962823 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:50.962560 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1583dea22054ad8ca1339c6c30428b2038d4e0bc9cc4b293ef1bc1927d183221" Sep 08 13:23:53.246234 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:53.246199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:53.380395 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:53.380359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:23:55.215072 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc"] Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215360 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="util" Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215371 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="util" Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215387 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="extract" Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215392 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="extract" Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215403 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="pull" Sep 08 13:23:55.215442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="pull" Sep 08 13:23:55.215629 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.215466 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d48380d-8eb4-4be0-8c12-7e1ec0f0142e" containerName="extract" Sep 08 13:23:55.223019 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.222990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.225661 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.225631 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 08 13:23:55.225811 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.225631 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-znrt2\"" Sep 08 13:23:55.226196 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.226165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 08 13:23:55.226370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.226353 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 08 13:23:55.236730 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.236694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc"] Sep 08 13:23:55.237035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.237011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltk44\" (UniqueName: \"kubernetes.io/projected/d4d88d34-97cb-4ade-b03a-cf271986d38b-kube-api-access-ltk44\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.237126 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.237071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d4d88d34-97cb-4ade-b03a-cf271986d38b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.338332 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.338285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltk44\" (UniqueName: \"kubernetes.io/projected/d4d88d34-97cb-4ade-b03a-cf271986d38b-kube-api-access-ltk44\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.338545 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.338373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d4d88d34-97cb-4ade-b03a-cf271986d38b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.340727 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.340702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d4d88d34-97cb-4ade-b03a-cf271986d38b-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.347856 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.347825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltk44\" (UniqueName: \"kubernetes.io/projected/d4d88d34-97cb-4ade-b03a-cf271986d38b-kube-api-access-ltk44\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-9k8bc\" (UID: \"d4d88d34-97cb-4ade-b03a-cf271986d38b\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.533406 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.533311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:23:55.825752 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.825719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc"] Sep 08 13:23:55.827305 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:23:55.827273 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d88d34_97cb_4ade_b03a_cf271986d38b.slice/crio-e27eaa4b1a648a05c828650c828b50c2aa7fafde920ffd004b6e1fd06db0389c WatchSource:0}: Error finding container e27eaa4b1a648a05c828650c828b50c2aa7fafde920ffd004b6e1fd06db0389c: Status 404 returned error can't find the container with id e27eaa4b1a648a05c828650c828b50c2aa7fafde920ffd004b6e1fd06db0389c Sep 08 13:23:55.984340 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:23:55.984296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" event={"ID":"d4d88d34-97cb-4ade-b03a-cf271986d38b","Type":"ContainerStarted","Data":"e27eaa4b1a648a05c828650c828b50c2aa7fafde920ffd004b6e1fd06db0389c"} Sep 08 13:24:00.006727 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.006690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" event={"ID":"d4d88d34-97cb-4ade-b03a-cf271986d38b","Type":"ContainerStarted","Data":"d33bf97185eb67deff0b67a6ce380fc36fc5d15709e0a0809509bd8ef9e96240"} Sep 08 13:24:00.007314 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.006833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:24:00.029642 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.029569 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" podStartSLOduration=1.374840556 podStartE2EDuration="5.029551381s" totalImagesPullingTime="3.654710825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:24:00.026807522 +0000 UTC m=+418.234465622" watchObservedRunningTime="2026-09-08 13:24:00.029551381 +0000 UTC m=+418.237209534" Sep 08 13:24:00.053475 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.053439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:00.821092 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.821056 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv"] Sep 08 13:24:00.842526 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.842492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv"] Sep 08 13:24:00.842696 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.842625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.845807 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.845778 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 08 13:24:00.846153 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.846136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 08 13:24:00.846936 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.846899 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-2g6xl\"" Sep 08 13:24:00.876974 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.876932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.877189 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.876982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclj7\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-kube-api-access-bclj7\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.877189 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.877053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.978119 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.978081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.978311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.978141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.978311 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.978184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bclj7\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-kube-api-access-bclj7\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.978311 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:24:00.978233 2576 secret.go:281] references non-existent secret key: tls.crt Sep 08 13:24:00.978311 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:24:00.978255 2576 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 08 13:24:00.978311 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:24:00.978275 2576 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv: references non-existent secret key: tls.crt Sep 08 13:24:00.978566 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:24:00.978345 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates podName:df650f49-35bc-4feb-bb1b-00cdc3c3f40f nodeName:}" failed. No retries permitted until 2026-09-08 13:24:01.478322399 +0000 UTC m=+419.685980478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates") pod "keda-metrics-apiserver-77857b7b98-c4kkv" (UID: "df650f49-35bc-4feb-bb1b-00cdc3c3f40f") : references non-existent secret key: tls.crt Sep 08 13:24:00.978628 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.978556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:00.992051 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:00.992008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclj7\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-kube-api-access-bclj7\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:01.483070 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.483029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:01.485675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.485644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/df650f49-35bc-4feb-bb1b-00cdc3c3f40f-certificates\") pod \"keda-metrics-apiserver-77857b7b98-c4kkv\" (UID: \"df650f49-35bc-4feb-bb1b-00cdc3c3f40f\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:01.519819 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.519781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:01.618463 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.618427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:01.718379 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.718342 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:01.753952 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.753855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:01.920641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:01.920610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:02.063464 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:02.063400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv"] Sep 08 13:24:02.069087 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:02.068984 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:02.159302 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:02.159264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:03.023624 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:03.023589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" event={"ID":"df650f49-35bc-4feb-bb1b-00cdc3c3f40f","Type":"ContainerStarted","Data":"6544ca0358e1b9aaa7512a302a1359431a4d7aa46465c27c146960907c8c6758"} Sep 08 13:24:07.045676 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:07.045637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" event={"ID":"df650f49-35bc-4feb-bb1b-00cdc3c3f40f","Type":"ContainerStarted","Data":"d67df7cbe6e145550f9e0f715d9985e1be6e352c569d2943f8479d117db10f9a"} Sep 08 13:24:07.046081 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:07.045775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:07.066358 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:07.066293 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" podStartSLOduration=2.938231782 podStartE2EDuration="7.066267358s" totalImagesPullingTime="4.128035576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:24:07.064332805 +0000 UTC m=+425.271990924" watchObservedRunningTime="2026-09-08 13:24:07.066267358 +0000 UTC m=+425.273925454" Sep 08 13:24:18.058182 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:18.058153 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-c4kkv" Sep 08 13:24:21.015194 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:21.015161 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-9k8bc" Sep 08 13:24:35.083796 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:35.083753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:39.616163 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:39.616120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:52.287439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:52.287400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:24:52.370514 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:24:52.370481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:21.541320 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.541281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:21.617674 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.617632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:21.622264 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.622234 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:25:21.624507 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.624491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.627261 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.627238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 08 13:25:21.627392 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.627264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 08 13:25:21.628049 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.628033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 08 13:25:21.628121 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.628057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-xxc4d\"" Sep 08 13:25:21.636876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.636850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:25:21.661029 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.660994 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-9v798"] Sep 08 13:25:21.663267 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.663248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.665974 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.665948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-lnbgj\"" Sep 08 13:25:21.666193 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.666178 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 08 13:25:21.676432 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.676404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngd4\" (UniqueName: \"kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.676558 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.676459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.681515 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.681486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9v798"] Sep 08 13:25:21.696480 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.696444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:21.763470 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.763437 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:21.777354 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.777314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgtb\" (UniqueName: \"kubernetes.io/projected/8f7f99d0-1617-4101-8837-c863916f5f5a-kube-api-access-bhgtb\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.777512 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.777369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngd4\" (UniqueName: \"kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.777512 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.777464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.777512 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.777498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f7f99d0-1617-4101-8837-c863916f5f5a-data\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.777631 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:25:21.777611 2576 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 08 13:25:21.777708 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:25:21.777698 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert podName:8b5def6f-753b-4a62-91d6-8eb7011d25d2 nodeName:}" failed. No retries permitted until 2026-09-08 13:25:22.277679802 +0000 UTC m=+500.485337877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert") pod "kserve-controller-manager-575d6764f4-dxv6n" (UID: "8b5def6f-753b-4a62-91d6-8eb7011d25d2") : secret "kserve-webhook-server-cert" not found Sep 08 13:25:21.796199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.796143 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngd4\" (UniqueName: \"kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:21.878551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.878511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f7f99d0-1617-4101-8837-c863916f5f5a-data\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.878741 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.878575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgtb\" (UniqueName: \"kubernetes.io/projected/8f7f99d0-1617-4101-8837-c863916f5f5a-kube-api-access-bhgtb\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.879016 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.878991 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8f7f99d0-1617-4101-8837-c863916f5f5a-data\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.893254 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.893227 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgtb\" (UniqueName: \"kubernetes.io/projected/8f7f99d0-1617-4101-8837-c863916f5f5a-kube-api-access-bhgtb\") pod \"seaweedfs-64568bcd49-9v798\" (UID: \"8f7f99d0-1617-4101-8837-c863916f5f5a\") " pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:21.972604 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:21.972563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:22.244974 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.244946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9v798"] Sep 08 13:25:22.247087 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:25:22.247058 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7f99d0_1617_4101_8837_c863916f5f5a.slice/crio-fb334dce82ba5c72743f7ecda00e36386d4fc69bb4724dbb95925c8afad1b72c WatchSource:0}: Error finding container fb334dce82ba5c72743f7ecda00e36386d4fc69bb4724dbb95925c8afad1b72c: Status 404 returned error can't find the container with id fb334dce82ba5c72743f7ecda00e36386d4fc69bb4724dbb95925c8afad1b72c Sep 08 13:25:22.283472 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.283436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:22.285937 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.285898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") pod \"kserve-controller-manager-575d6764f4-dxv6n\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:22.403707 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.403664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9v798" event={"ID":"8f7f99d0-1617-4101-8837-c863916f5f5a","Type":"ContainerStarted","Data":"fb334dce82ba5c72743f7ecda00e36386d4fc69bb4724dbb95925c8afad1b72c"} Sep 08 13:25:22.535207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.535107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:22.811243 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:22.811216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:25:22.813398 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:25:22.813363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5def6f_753b_4a62_91d6_8eb7011d25d2.slice/crio-54a7fa1cb3c785e12befd9759221a87f3949b0bd83e660bfc42c5c2446681cf1 WatchSource:0}: Error finding container 54a7fa1cb3c785e12befd9759221a87f3949b0bd83e660bfc42c5c2446681cf1: Status 404 returned error can't find the container with id 54a7fa1cb3c785e12befd9759221a87f3949b0bd83e660bfc42c5c2446681cf1 Sep 08 13:25:23.409422 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:23.409381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" event={"ID":"8b5def6f-753b-4a62-91d6-8eb7011d25d2","Type":"ContainerStarted","Data":"54a7fa1cb3c785e12befd9759221a87f3949b0bd83e660bfc42c5c2446681cf1"} Sep 08 13:25:23.860668 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:23.860612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:23.969015 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:23.968963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:26.424286 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:26.424248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" event={"ID":"8b5def6f-753b-4a62-91d6-8eb7011d25d2","Type":"ContainerStarted","Data":"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2"} Sep 08 13:25:26.424728 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:26.424437 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:25:26.451054 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:26.450994 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" podStartSLOduration=2.050508322 podStartE2EDuration="5.450975445s" totalImagesPullingTime="3.400467123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:26.450044726 +0000 UTC m=+504.657702822" watchObservedRunningTime="2026-09-08 13:25:26.450975445 +0000 UTC m=+504.658633540" Sep 08 13:25:32.454930 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:32.454874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9v798" event={"ID":"8f7f99d0-1617-4101-8837-c863916f5f5a","Type":"ContainerStarted","Data":"a6f1cf2646e42024b424f334f286bedc4e6ffc0f8d21937be24a02a0d013afc9"} Sep 08 13:25:32.455348 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:32.455082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:32.483299 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:32.483240 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-9v798" podStartSLOduration=2.091747331 podStartE2EDuration="11.483224839s" totalImagesPullingTime="9.391477508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:32.483079891 +0000 UTC m=+510.690737988" watchObservedRunningTime="2026-09-08 13:25:32.483224839 +0000 UTC m=+510.690882934" Sep 08 13:25:33.280499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.280459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77b46778c8-cz4s6"] Sep 08 13:25:33.283752 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.283723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.310261 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.310227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b46778c8-cz4s6"] Sep 08 13:25:33.348115 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.348044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:33.385731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-console-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.385731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.386001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-oauth-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.386001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-service-ca\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.386001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-trusted-ca-bundle\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.386001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnd47\" (UniqueName: \"kubernetes.io/projected/73d33780-6534-4b8c-ad5d-28634043bf2f-kube-api-access-qnd47\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.386001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.385975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-oauth-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.415278 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.415243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:33.486840 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-console-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.486840 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-oauth-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-service-ca\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-trusted-ca-bundle\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.486991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnd47\" (UniqueName: \"kubernetes.io/projected/73d33780-6534-4b8c-ad5d-28634043bf2f-kube-api-access-qnd47\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487477 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.487131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-oauth-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487754 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.487713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-oauth-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487810 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.487750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-service-ca\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.487870 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.487811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-console-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.488034 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.488014 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33780-6534-4b8c-ad5d-28634043bf2f-trusted-ca-bundle\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.489588 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.489559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-serving-cert\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.489588 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.489573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33780-6534-4b8c-ad5d-28634043bf2f-console-oauth-config\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.496001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.495975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnd47\" (UniqueName: \"kubernetes.io/projected/73d33780-6534-4b8c-ad5d-28634043bf2f-kube-api-access-qnd47\") pod \"console-77b46778c8-cz4s6\" (UID: \"73d33780-6534-4b8c-ad5d-28634043bf2f\") " pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.594213 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.594123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:33.873312 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:33.873229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b46778c8-cz4s6"] Sep 08 13:25:33.876443 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:25:33.876411 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d33780_6534_4b8c_ad5d_28634043bf2f.slice/crio-34b009394d12e9dc1940e5e169bb2b3e94320df9b3368d7007751314641d594d WatchSource:0}: Error finding container 34b009394d12e9dc1940e5e169bb2b3e94320df9b3368d7007751314641d594d: Status 404 returned error can't find the container with id 34b009394d12e9dc1940e5e169bb2b3e94320df9b3368d7007751314641d594d Sep 08 13:25:34.466534 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:34.466494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b46778c8-cz4s6" event={"ID":"73d33780-6534-4b8c-ad5d-28634043bf2f","Type":"ContainerStarted","Data":"678502b644e7ba2eb018af19957674e84ad0e955f053e6a2ae040569774ff25a"} Sep 08 13:25:34.466758 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:34.466556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b46778c8-cz4s6" event={"ID":"73d33780-6534-4b8c-ad5d-28634043bf2f","Type":"ContainerStarted","Data":"34b009394d12e9dc1940e5e169bb2b3e94320df9b3368d7007751314641d594d"} Sep 08 13:25:34.488679 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:34.488616 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77b46778c8-cz4s6" podStartSLOduration=1.488599751 podStartE2EDuration="1.488599751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:34.486396143 +0000 UTC m=+512.694054258" watchObservedRunningTime="2026-09-08 13:25:34.488599751 +0000 UTC m=+512.696257847" Sep 08 13:25:38.462977 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:38.462941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-9v798" Sep 08 13:25:43.594393 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:43.594345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:43.594846 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:43.594413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:43.599710 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:43.599686 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:44.523781 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:44.523753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77b46778c8-cz4s6" Sep 08 13:25:44.582006 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:44.581970 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:25:44.699864 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:44.699817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:44.804210 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:44.804093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:49.735487 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:49.735450 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:25:57.435586 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:25:57.435508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:26:05.969367 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:05.969331 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:26:05.969757 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:05.969531 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" podUID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" containerName="manager" containerID="cri-o://ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2" gracePeriod=10 Sep 08 13:26:05.994276 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:05.994245 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-bxgs8"] Sep 08 13:26:05.996798 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:05.996781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.007019 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.006989 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-bxgs8"] Sep 08 13:26:06.076391 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.076348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5jx\" (UniqueName: \"kubernetes.io/projected/e7b13c10-e2cc-4225-a64b-0d66cc26103e-kube-api-access-sj5jx\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.076563 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.076464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b13c10-e2cc-4225-a64b-0d66cc26103e-cert\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.178026 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.177987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b13c10-e2cc-4225-a64b-0d66cc26103e-cert\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.178246 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.178093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5jx\" (UniqueName: \"kubernetes.io/projected/e7b13c10-e2cc-4225-a64b-0d66cc26103e-kube-api-access-sj5jx\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.180611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.180584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b13c10-e2cc-4225-a64b-0d66cc26103e-cert\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.186418 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.186391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5jx\" (UniqueName: \"kubernetes.io/projected/e7b13c10-e2cc-4225-a64b-0d66cc26103e-kube-api-access-sj5jx\") pod \"kserve-controller-manager-575d6764f4-bxgs8\" (UID: \"e7b13c10-e2cc-4225-a64b-0d66cc26103e\") " pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.209488 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.209458 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:26:06.278535 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.278464 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") pod \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " Sep 08 13:26:06.278535 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.278527 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ngd4\" (UniqueName: \"kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4\") pod \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\" (UID: \"8b5def6f-753b-4a62-91d6-8eb7011d25d2\") " Sep 08 13:26:06.280762 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.280723 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4" (OuterVolumeSpecName: "kube-api-access-4ngd4") pod "8b5def6f-753b-4a62-91d6-8eb7011d25d2" (UID: "8b5def6f-753b-4a62-91d6-8eb7011d25d2"). InnerVolumeSpecName "kube-api-access-4ngd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:26:06.280872 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.280811 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert" (OuterVolumeSpecName: "cert") pod "8b5def6f-753b-4a62-91d6-8eb7011d25d2" (UID: "8b5def6f-753b-4a62-91d6-8eb7011d25d2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:26:06.358613 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.358575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:06.379524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.379492 2576 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b5def6f-753b-4a62-91d6-8eb7011d25d2-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:06.379663 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.379526 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ngd4\" (UniqueName: \"kubernetes.io/projected/8b5def6f-753b-4a62-91d6-8eb7011d25d2-kube-api-access-4ngd4\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:06.620317 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.620218 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" containerID="ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2" exitCode=0 Sep 08 13:26:06.620317 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.620261 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" Sep 08 13:26:06.620317 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.620277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" event={"ID":"8b5def6f-753b-4a62-91d6-8eb7011d25d2","Type":"ContainerDied","Data":"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2"} Sep 08 13:26:06.620578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.620338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-dxv6n" event={"ID":"8b5def6f-753b-4a62-91d6-8eb7011d25d2","Type":"ContainerDied","Data":"54a7fa1cb3c785e12befd9759221a87f3949b0bd83e660bfc42c5c2446681cf1"} Sep 08 13:26:06.620578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.620366 2576 scope.go:117] "RemoveContainer" containerID="ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2" Sep 08 13:26:06.629850 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.629821 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-bxgs8"] Sep 08 13:26:06.630385 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.630364 2576 scope.go:117] "RemoveContainer" containerID="ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2" Sep 08 13:26:06.630741 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:06.630712 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2\": container with ID starting with ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2 not found: ID does not exist" containerID="ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2" Sep 08 13:26:06.630805 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.630750 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2"} err="failed to get container status \"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2\": rpc error: code = NotFound desc = could not find container \"ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2\": container with ID starting with ac54dbda4c33aa590a04978de0e4810ff60ca2e7bdcff1b149746e54c3a953b2 not found: ID does not exist" Sep 08 13:26:06.632115 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:26:06.632093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b13c10_e2cc_4225_a64b_0d66cc26103e.slice/crio-eb16913d1acda7fb165416cfb28e8f9bf0dd9d001d7c567e411f219e9034774a WatchSource:0}: Error finding container eb16913d1acda7fb165416cfb28e8f9bf0dd9d001d7c567e411f219e9034774a: Status 404 returned error can't find the container with id eb16913d1acda7fb165416cfb28e8f9bf0dd9d001d7c567e411f219e9034774a Sep 08 13:26:06.642681 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.642656 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:26:06.648028 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:06.648001 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-dxv6n"] Sep 08 13:26:07.626332 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:07.626296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" event={"ID":"e7b13c10-e2cc-4225-a64b-0d66cc26103e","Type":"ContainerStarted","Data":"373470ad2476e55c687acd8b83c372587fadcbcfa8e1bfb9a92bc40cf691e856"} Sep 08 13:26:07.626753 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:07.626349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" event={"ID":"e7b13c10-e2cc-4225-a64b-0d66cc26103e","Type":"ContainerStarted","Data":"eb16913d1acda7fb165416cfb28e8f9bf0dd9d001d7c567e411f219e9034774a"} Sep 08 13:26:07.626753 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:07.626409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:07.644955 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:07.644888 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" podStartSLOduration=2.153728375 podStartE2EDuration="2.644872979s" totalImagesPullingTime="491.144604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:26:07.6432336 +0000 UTC m=+545.850891718" watchObservedRunningTime="2026-09-08 13:26:07.644872979 +0000 UTC m=+545.852531110" Sep 08 13:26:08.275980 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:08.275943 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" path="/var/lib/kubelet/pods/8b5def6f-753b-4a62-91d6-8eb7011d25d2/volumes" Sep 08 13:26:09.603156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:09.603107 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bb99fffd6-m7fkm" podUID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" containerName="console" containerID="cri-o://94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92" gracePeriod=15 Sep 08 13:26:09.864589 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:09.864520 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:26:10.011504 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011462 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfx9k\" (UniqueName: \"kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011523 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011561 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011609 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011675 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011761 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.011838 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.011809 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config\") pod \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\" (UID: \"a976dd28-c284-42a9-94d8-d8cd7e13fc37\") " Sep 08 13:26:10.012074 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012046 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca" (OuterVolumeSpecName: "service-ca") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:26:10.012160 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012064 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:26:10.012160 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012101 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:26:10.012160 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012155 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-service-ca\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.012282 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012172 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-trusted-ca-bundle\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.012439 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.012411 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config" (OuterVolumeSpecName: "console-config") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:26:10.013841 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.013819 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k" (OuterVolumeSpecName: "kube-api-access-zfx9k") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "kube-api-access-zfx9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 13:26:10.013945 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.013840 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:26:10.013945 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.013854 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a976dd28-c284-42a9-94d8-d8cd7e13fc37" (UID: "a976dd28-c284-42a9-94d8-d8cd7e13fc37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:26:10.112749 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.112708 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-oauth-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.112749 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.112741 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-oauth-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.112749 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.112751 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-serving-cert\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.112749 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.112760 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a976dd28-c284-42a9-94d8-d8cd7e13fc37-console-config\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.113067 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.112769 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfx9k\" (UniqueName: \"kubernetes.io/projected/a976dd28-c284-42a9-94d8-d8cd7e13fc37-kube-api-access-zfx9k\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:26:10.642559 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.642457 2576 generic.go:356] "Generic (PLEG): container finished" podID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" containerID="94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92" exitCode=0 Sep 08 13:26:10.642559 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.642500 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb99fffd6-m7fkm" Sep 08 13:26:10.642559 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.642505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb99fffd6-m7fkm" event={"ID":"a976dd28-c284-42a9-94d8-d8cd7e13fc37","Type":"ContainerDied","Data":"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92"} Sep 08 13:26:10.642559 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.642556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb99fffd6-m7fkm" event={"ID":"a976dd28-c284-42a9-94d8-d8cd7e13fc37","Type":"ContainerDied","Data":"a98fc694821b520156a60aa68658b0d5d12b85224445d23b14f828800d41b0d1"} Sep 08 13:26:10.643126 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.642583 2576 scope.go:117] "RemoveContainer" containerID="94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92" Sep 08 13:26:10.651274 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.651250 2576 scope.go:117] "RemoveContainer" containerID="94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92" Sep 08 13:26:10.651594 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:10.651573 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92\": container with ID starting with 94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92 not found: ID does not exist" containerID="94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92" Sep 08 13:26:10.651660 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.651608 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92"} err="failed to get container status \"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92\": rpc error: code = NotFound desc = could not find container \"94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92\": container with ID starting with 94fd26615cc238809fbf54a465e10b094bc8debe752e0f0815f4b12a9e1b3a92 not found: ID does not exist" Sep 08 13:26:10.659641 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.659608 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:26:10.668807 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:10.668776 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bb99fffd6-m7fkm"] Sep 08 13:26:12.276065 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:12.276032 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" path="/var/lib/kubelet/pods/a976dd28-c284-42a9-94d8-d8cd7e13fc37/volumes" Sep 08 13:26:38.637617 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:38.637585 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-575d6764f4-bxgs8" Sep 08 13:26:39.893714 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.893670 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:39.925275 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925244 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-mh4bg"] Sep 08 13:26:39.925652 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925634 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" containerName="manager" Sep 08 13:26:39.925695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925656 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" containerName="manager" Sep 08 13:26:39.925695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925692 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" containerName="console" Sep 08 13:26:39.925757 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" containerName="console" Sep 08 13:26:39.925796 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925787 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a976dd28-c284-42a9-94d8-d8cd7e13fc37" containerName="console" Sep 08 13:26:39.925829 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.925802 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5def6f-753b-4a62-91d6-8eb7011d25d2" containerName="manager" Sep 08 13:26:39.928233 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.928206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:39.930956 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.930931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-4vzr4\"" Sep 08 13:26:39.931097 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.930936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Sep 08 13:26:39.938372 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.938341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-mh4bg"] Sep 08 13:26:39.941082 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.941054 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-jx5js"] Sep 08 13:26:39.943427 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.943404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:39.946198 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.946176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\"" Sep 08 13:26:39.946319 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.946181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Sep 08 13:26:39.946319 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.946298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-nj8zn\"" Sep 08 13:26:39.954564 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.954532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-jx5js"] Sep 08 13:26:39.970878 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.970845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:39.971084 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.971005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:39.971084 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.971046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gq4\" (UniqueName: \"kubernetes.io/projected/100f97c2-1a3d-4dcc-9674-31b210e98185-kube-api-access-f4gq4\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:39.971207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.971117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:39.971207 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.971141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lfc\" (UniqueName: \"kubernetes.io/projected/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-kube-api-access-f8lfc\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:39.975869 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:39.975840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:40.072018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.071978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.072018 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.072020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lfc\" (UniqueName: \"kubernetes.io/projected/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-kube-api-access-f8lfc\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.072277 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072138 2576 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 08 13:26:40.072277 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072201 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs podName:100f97c2-1a3d-4dcc-9674-31b210e98185 nodeName:}" failed. No retries permitted until 2026-09-08 13:26:40.572181293 +0000 UTC m=+578.779839368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs") pod "model-serving-api-7b954ffc95-mh4bg" (UID: "100f97c2-1a3d-4dcc-9674-31b210e98185") : secret "model-serving-api-tls" not found Sep 08 13:26:40.072277 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.072138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.072430 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072201 2576 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 08 13:26:40.072430 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.072304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.072430 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.072333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gq4\" (UniqueName: \"kubernetes.io/projected/100f97c2-1a3d-4dcc-9674-31b210e98185-kube-api-access-f4gq4\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.072430 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072359 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert podName:b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5 nodeName:}" failed. No retries permitted until 2026-09-08 13:26:40.572345941 +0000 UTC m=+578.780004019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert") pod "odh-model-controller-7b966d7984-jx5js" (UID: "b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5") : secret "odh-model-controller-webhook-cert" not found Sep 08 13:26:40.072430 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072408 2576 secret.go:189] Couldn't get secret kserve/odh-model-controller-metrics-tls: secret "odh-model-controller-metrics-tls" not found Sep 08 13:26:40.072601 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:26:40.072449 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs podName:b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5 nodeName:}" failed. No retries permitted until 2026-09-08 13:26:40.572436875 +0000 UTC m=+578.780094956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs") pod "odh-model-controller-7b966d7984-jx5js" (UID: "b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5") : secret "odh-model-controller-metrics-tls" not found Sep 08 13:26:40.082135 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.082100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gq4\" (UniqueName: \"kubernetes.io/projected/100f97c2-1a3d-4dcc-9674-31b210e98185-kube-api-access-f4gq4\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.082322 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.082297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lfc\" (UniqueName: \"kubernetes.io/projected/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-kube-api-access-f8lfc\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.299274 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.299227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:40.526108 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.526069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:40.577163 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.577064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.577163 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.577146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.577403 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.577177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.579635 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.579607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-metrics-certs\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.579755 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.579677 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/100f97c2-1a3d-4dcc-9674-31b210e98185-tls-certs\") pod \"model-serving-api-7b954ffc95-mh4bg\" (UID: \"100f97c2-1a3d-4dcc-9674-31b210e98185\") " pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.579755 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.579721 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5-cert\") pod \"odh-model-controller-7b966d7984-jx5js\" (UID: \"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5\") " pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:40.626540 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.626502 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:40.839357 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.839265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:40.855524 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:40.855487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:41.026453 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.026421 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:41.089085 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.089040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:26:41.113821 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.113794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-mh4bg"] Sep 08 13:26:41.116146 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:26:41.116113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100f97c2_1a3d_4dcc_9674_31b210e98185.slice/crio-7653319d2b51aa8460bbd67a03dd73337be587b9d73e3f744d2b0f006d956cb1 WatchSource:0}: Error finding container 7653319d2b51aa8460bbd67a03dd73337be587b9d73e3f744d2b0f006d956cb1: Status 404 returned error can't find the container with id 7653319d2b51aa8460bbd67a03dd73337be587b9d73e3f744d2b0f006d956cb1 Sep 08 13:26:41.136536 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.136509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-jx5js"] Sep 08 13:26:41.138476 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:26:41.138451 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3764d7e_5ec6_4af5_84a1_4931b5cbd7d5.slice/crio-fd5f88d3730eb971e38786c6a090ae5aca97b754b3e15cf2f815ddf1b241c2b6 WatchSource:0}: Error finding container fd5f88d3730eb971e38786c6a090ae5aca97b754b3e15cf2f815ddf1b241c2b6: Status 404 returned error can't find the container with id fd5f88d3730eb971e38786c6a090ae5aca97b754b3e15cf2f815ddf1b241c2b6 Sep 08 13:26:41.796222 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.796186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-mh4bg" event={"ID":"100f97c2-1a3d-4dcc-9674-31b210e98185","Type":"ContainerStarted","Data":"7653319d2b51aa8460bbd67a03dd73337be587b9d73e3f744d2b0f006d956cb1"} Sep 08 13:26:41.797551 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:41.797520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-jx5js" event={"ID":"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5","Type":"ContainerStarted","Data":"fd5f88d3730eb971e38786c6a090ae5aca97b754b3e15cf2f815ddf1b241c2b6"} Sep 08 13:26:44.820279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:44.820198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-jx5js" event={"ID":"b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5","Type":"ContainerStarted","Data":"f85e0aba350b3941698f0d15025b9365d311349bb5b2b4cdc5b6c577d3b28974"} Sep 08 13:26:44.820760 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:44.820345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:45.827255 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:45.827217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-mh4bg" event={"ID":"100f97c2-1a3d-4dcc-9674-31b210e98185","Type":"ContainerStarted","Data":"138cb887ad7d24e8ace11f4988beb1b83b0d72678951ac36d049a8a63a6ba11d"} Sep 08 13:26:45.875365 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:45.875311 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-mh4bg" podStartSLOduration=3.04783712 podStartE2EDuration="6.875294561s" totalImagesPullingTime="3.827457441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:26:45.87498975 +0000 UTC m=+584.082647869" watchObservedRunningTime="2026-09-08 13:26:45.875294561 +0000 UTC m=+584.082952651" Sep 08 13:26:45.876193 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:45.876161 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-jx5js" podStartSLOduration=4.056107826 podStartE2EDuration="6.876152235s" totalImagesPullingTime="2.820044409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:26:44.867723104 +0000 UTC m=+583.075381219" watchObservedRunningTime="2026-09-08 13:26:45.876152235 +0000 UTC m=+584.083810336" Sep 08 13:26:46.835395 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:46.835360 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:26:55.829824 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:55.829788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-jx5js" Sep 08 13:26:57.843908 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:26:57.843878 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-mh4bg" Sep 08 13:27:02.180003 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:27:02.179970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:27:02.180494 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:27:02.180464 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:27:02.186959 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:27:02.186934 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:27:02.187661 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:27:02.187637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:27:24.393652 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:27:24.393565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:16.074772 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:16.074733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:16.173055 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:16.173014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:27.887775 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:27.887736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:28.076698 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:28.076651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:28.143157 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:28.143056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:28.276246 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:28.276206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:28.375064 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:28.375024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:28:28.476341 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:28:28.476292 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:17.862564 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:17.862526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:23.115310 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:23.115272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:23.239605 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:23.239559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:23.356929 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:23.356874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:23.461260 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:23.461230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:23.839853 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:23.839777 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:56.142752 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:56.142714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:30:56.243806 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:30:56.243769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:06.681040 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:06.681009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:47.972731 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:47.972674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:53.128569 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:53.128534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:53.217786 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:53.217752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:53.425694 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:53.425657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:31:53.770951 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:31:53.770836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:02.211782 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:02.211745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:32:02.213149 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:02.213128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:32:02.218476 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:02.218453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:32:02.219829 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:02.219807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:32:03.098049 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.098015 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:03.100442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.100417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.103001 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.102976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 08 13:32:03.103162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.103010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-3d858-serving-cert\"" Sep 08 13:32:03.103162 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.103162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-48hwc\"" Sep 08 13:32:03.104102 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.104080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-3d858-kube-rbac-proxy-sar-config\"" Sep 08 13:32:03.110118 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.110096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:03.159086 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.159040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.159254 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.159166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.260578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.260538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.260578 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.260583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.261248 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.261228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.263105 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.263087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls\") pod \"model-chainer-raw-3d858-7665b6bd96-87w8z\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.412310 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.412213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:03.683756 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.683625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:03.686792 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:32:03.686760 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3814ea83_0eaa_4537_a432_0262be5e2fd2.slice/crio-2c82ee01d0c964acf37465119be29d522aa787482fc7af26864ef776c92bd009 WatchSource:0}: Error finding container 2c82ee01d0c964acf37465119be29d522aa787482fc7af26864ef776c92bd009: Status 404 returned error can't find the container with id 2c82ee01d0c964acf37465119be29d522aa787482fc7af26864ef776c92bd009 Sep 08 13:32:03.689206 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.689190 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 13:32:03.965584 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:03.965470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:04.354450 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:04.354360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" event={"ID":"3814ea83-0eaa-4537-a432-0262be5e2fd2","Type":"ContainerStarted","Data":"2c82ee01d0c964acf37465119be29d522aa787482fc7af26864ef776c92bd009"} Sep 08 13:32:04.436343 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:04.436299 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:06.370639 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:06.370604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" event={"ID":"3814ea83-0eaa-4537-a432-0262be5e2fd2","Type":"ContainerStarted","Data":"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f"} Sep 08 13:32:06.371057 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:06.370717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:06.387161 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:06.387106 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podStartSLOduration=1.391625163 podStartE2EDuration="3.386998197s" totalImagesPullingTime="1.995373034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:32:06.386501907 +0000 UTC m=+904.594160037" watchObservedRunningTime="2026-09-08 13:32:06.386998197 +0000 UTC m=+904.594656295" Sep 08 13:32:12.381135 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:12.381103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:13.171469 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.171432 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:13.171753 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.171688 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" containerID="cri-o://80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f" gracePeriod=30 Sep 08 13:32:13.191442 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.191404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:13.303704 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.303672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:13.402239 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.402196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:13.503618 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.503533 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:13.570295 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.570264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:13.692401 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:13.692357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:15.186833 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:15.186784 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:32:17.380443 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:17.380402 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:22.379691 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:22.379650 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:27.380172 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:27.380129 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:27.381794 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:27.380249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:32.379863 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:32.379821 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:37.379502 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:37.379451 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:42.379798 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:42.379755 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:32:43.219950 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:32:43.219889 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3814ea83_0eaa_4537_a432_0262be5e2fd2.slice/crio-conmon-80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f.scope\": RecentStats: unable to find data in memory cache]" Sep 08 13:32:43.325408 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.325373 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:43.412898 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.412862 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle\") pod \"3814ea83-0eaa-4537-a432-0262be5e2fd2\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " Sep 08 13:32:43.412898 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.412903 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls\") pod \"3814ea83-0eaa-4537-a432-0262be5e2fd2\" (UID: \"3814ea83-0eaa-4537-a432-0262be5e2fd2\") " Sep 08 13:32:43.413431 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.413310 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3814ea83-0eaa-4537-a432-0262be5e2fd2" (UID: "3814ea83-0eaa-4537-a432-0262be5e2fd2"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:32:43.415286 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.415261 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3814ea83-0eaa-4537-a432-0262be5e2fd2" (UID: "3814ea83-0eaa-4537-a432-0262be5e2fd2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:32:43.514497 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.514395 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3814ea83-0eaa-4537-a432-0262be5e2fd2-openshift-service-ca-bundle\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:32:43.514497 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.514434 2576 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3814ea83-0eaa-4537-a432-0262be5e2fd2-proxy-tls\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:32:43.554802 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.554764 2576 generic.go:356] "Generic (PLEG): container finished" podID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerID="80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f" exitCode=0 Sep 08 13:32:43.554992 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.554814 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" Sep 08 13:32:43.554992 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.554840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" event={"ID":"3814ea83-0eaa-4537-a432-0262be5e2fd2","Type":"ContainerDied","Data":"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f"} Sep 08 13:32:43.554992 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.554894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z" event={"ID":"3814ea83-0eaa-4537-a432-0262be5e2fd2","Type":"ContainerDied","Data":"2c82ee01d0c964acf37465119be29d522aa787482fc7af26864ef776c92bd009"} Sep 08 13:32:43.554992 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.554933 2576 scope.go:117] "RemoveContainer" containerID="80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f" Sep 08 13:32:43.563810 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.563787 2576 scope.go:117] "RemoveContainer" containerID="80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f" Sep 08 13:32:43.564151 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:32:43.564132 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f\": container with ID starting with 80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f not found: ID does not exist" containerID="80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f" Sep 08 13:32:43.564199 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.564159 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f"} err="failed to get container status \"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f\": rpc error: code = NotFound desc = could not find container \"80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f\": container with ID starting with 80bb61001b3eca77b6f83811b2c18361733ecaa46496700f98d4b5faf906870f not found: ID does not exist" Sep 08 13:32:43.576596 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.576563 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:43.583035 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:43.582998 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-3d858-7665b6bd96-87w8z"] Sep 08 13:32:44.275330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:44.275286 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" path="/var/lib/kubelet/pods/3814ea83-0eaa-4537-a432-0262be5e2fd2/volumes" Sep 08 13:32:52.647065 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:32:52.647026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:23.192457 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:23.192418 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:23.286370 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:23.286330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:33.384262 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:33.384224 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:33.801261 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:33.801209 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:53.435839 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.435802 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:33:53.436342 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.436199 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" Sep 08 13:33:53.436342 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.436212 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" Sep 08 13:33:53.436342 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.436265 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3814ea83-0eaa-4537-a432-0262be5e2fd2" containerName="model-chainer-raw-3d858" Sep 08 13:33:53.438410 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.438391 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.440844 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.440814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-90436-serving-cert\"" Sep 08 13:33:53.441030 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.440894 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-48hwc\"" Sep 08 13:33:53.441030 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.440951 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-90436-kube-rbac-proxy-sar-config\"" Sep 08 13:33:53.441030 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.440972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 08 13:33:53.447876 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.447849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:33:53.456173 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.456140 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:53.534027 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.533988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.534203 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.534041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.634805 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.634767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.635000 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.634823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.635000 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:33:53.634938 2576 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-90436-serving-cert: secret "model-chainer-raw-hpa-90436-serving-cert" not found Sep 08 13:33:53.635105 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:33:53.635005 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls podName:c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd nodeName:}" failed. No retries permitted until 2026-09-08 13:33:54.134984732 +0000 UTC m=+1012.342642825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls") pod "model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" (UID: "c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd") : secret "model-chainer-raw-hpa-90436-serving-cert" not found Sep 08 13:33:53.635499 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.635478 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:53.842126 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:53.842041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:33:54.139016 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.138868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:54.141369 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.141345 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") pod \"model-chainer-raw-hpa-90436-866fb7b47b-2xx9p\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:54.350149 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.350097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:54.623457 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.623431 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:33:54.625727 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:33:54.625698 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fe5d6f_4377_4ece_afbc_eeaf4abc7efd.slice/crio-d87456c5da9343620b054ddba2ef4a416277165e76cbfbbd1fd018e46f0e15db WatchSource:0}: Error finding container d87456c5da9343620b054ddba2ef4a416277165e76cbfbbd1fd018e46f0e15db: Status 404 returned error can't find the container with id d87456c5da9343620b054ddba2ef4a416277165e76cbfbbd1fd018e46f0e15db Sep 08 13:33:54.897450 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.897416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" event={"ID":"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd","Type":"ContainerStarted","Data":"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727"} Sep 08 13:33:54.897657 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.897469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" event={"ID":"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd","Type":"ContainerStarted","Data":"d87456c5da9343620b054ddba2ef4a416277165e76cbfbbd1fd018e46f0e15db"} Sep 08 13:33:54.897657 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.897501 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:33:54.915535 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:33:54.915402 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podStartSLOduration=1.915379834 podStartE2EDuration="1.915379834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:33:54.913641846 +0000 UTC m=+1013.121299954" watchObservedRunningTime="2026-09-08 13:33:54.915379834 +0000 UTC m=+1013.123037929" Sep 08 13:34:00.909042 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:00.909006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:34:03.514506 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.514465 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:34:03.514907 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.514695 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" containerID="cri-o://b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727" gracePeriod=30 Sep 08 13:34:03.555673 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.555636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:03.748684 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.748652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:03.820766 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.820681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:03.914502 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:03.914468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:04.150140 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:04.150057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:05.907337 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:05.907298 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:10.906680 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:10.906626 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:15.907484 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:15.907444 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:15.907893 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:15.907576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:34:20.906595 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:20.906552 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:23.742141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:23.742108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:23.920972 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:23.920937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:34:25.907544 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:25.907500 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:30.906979 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:30.906938 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 13:34:33.672773 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.672744 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:34:33.788182 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.788088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") pod \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " Sep 08 13:34:33.788182 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.788151 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle\") pod \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\" (UID: \"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd\") " Sep 08 13:34:33.788537 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.788508 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" (UID: "c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 13:34:33.790248 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.790221 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" (UID: "c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 13:34:33.889008 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.888954 2576 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-proxy-tls\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:34:33.889008 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:33.888998 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd-openshift-service-ca-bundle\") on node \"ip-10-0-142-86.ec2.internal\" DevicePath \"\"" Sep 08 13:34:34.086617 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.086524 2576 generic.go:356] "Generic (PLEG): container finished" podID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerID="b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727" exitCode=0 Sep 08 13:34:34.086617 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.086576 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" Sep 08 13:34:34.086812 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.086614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" event={"ID":"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd","Type":"ContainerDied","Data":"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727"} Sep 08 13:34:34.086812 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.086727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p" event={"ID":"c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd","Type":"ContainerDied","Data":"d87456c5da9343620b054ddba2ef4a416277165e76cbfbbd1fd018e46f0e15db"} Sep 08 13:34:34.086812 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.086756 2576 scope.go:117] "RemoveContainer" containerID="b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727" Sep 08 13:34:34.096131 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.096109 2576 scope.go:117] "RemoveContainer" containerID="b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727" Sep 08 13:34:34.096422 ip-10-0-142-86 kubenswrapper[2576]: E0908 13:34:34.096401 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727\": container with ID starting with b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727 not found: ID does not exist" containerID="b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727" Sep 08 13:34:34.096491 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.096436 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727"} err="failed to get container status \"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727\": rpc error: code = NotFound desc = could not find container \"b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727\": container with ID starting with b7afab48dfc583ead06a42c4e0b965298ec527b157db4864005d5e3bb88d8727 not found: ID does not exist" Sep 08 13:34:34.109214 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.109187 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:34:34.113744 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.113718 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-90436-866fb7b47b-2xx9p"] Sep 08 13:34:34.275638 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:34:34.275598 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" path="/var/lib/kubelet/pods/c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd/volumes" Sep 08 13:35:18.574474 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:18.574435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:19.201650 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:19.201607 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:34.669654 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:34.669617 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:36.459116 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:36.459071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:37.702418 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:37.702383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:37.779077 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:37.779049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:39.838235 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:39.838199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:40.252085 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:40.252054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:49.931031 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:49.930993 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:55.099354 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:55.099318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:55.253657 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:55.253614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:59.003649 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:59.003595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:59.100078 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:59.100042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:35:59.180281 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:35:59.180246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:37:02.242040 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:02.242012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:37:02.244545 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:02.244522 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:37:02.249176 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:02.249149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:37:02.251696 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:02.251671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:37:25.253466 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:25.253428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:37:30.369857 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:30.369819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:37:30.575990 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:37:30.575958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:39.169633 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:39.169600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:44.335774 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:44.335738 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:44.432547 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:44.432510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:44.629277 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:44.629199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:44.814223 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:44.814191 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:38:49.641827 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:38:49.641793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:39:01.194958 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:39:01.194896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:14.477695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:14.477648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:14.562936 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:14.562865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:19.642079 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:19.642035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:19.744651 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:19.744611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:20.151976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:20.151943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:20.277156 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:20.277113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:40:59.457948 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:40:59.457840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:41:01.697443 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:41:01.697398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:41:49.742299 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:41:49.742250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:42:02.278382 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:42:02.278350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:42:02.281293 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:42:02.281266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:42:02.285433 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:42:02.285408 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:42:02.288100 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:42:02.288079 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:43:20.211862 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:20.211827 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:43:34.244230 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:34.244173 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:43:34.440289 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:34.440252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:43:44.328550 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:44.328500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:43:44.574888 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:44.574844 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:43:58.364330 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:43:58.364239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:09.578383 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:09.578339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:09.677514 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:09.677478 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:10.400454 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:10.400405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:10.500548 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:10.500501 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:40.859680 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:40.859643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:41.030155 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:41.030113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:41.171650 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:41.171608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:44.447506 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:44.447475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rfk4c_1a1ab0ac-6fb8-4aeb-995e-b356fca294dc/global-pull-secret-syncer/0.log" Sep 08 13:45:44.502032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:44.502001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" Sep 08 13:45:44.631756 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:44.631719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-86.ec2.internal_fc722220b0bff438767064ce86b64eb2/haproxy/0.log" Sep 08 13:45:47.827255 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:47.827214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:47.948536 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:47.948494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58hdt_c0d397dd-0678-41ca-9131-56ea93caac19/konnectivity-agent/0.log" limit=1024 Sep 08 13:45:49.041626 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.041595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-4z9vw_cd8eb86c-a1e7-4e3b-835c-68b781053a3b/cluster-monitoring-operator/0.log" Sep 08 13:45:49.173943 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.173898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c4c4d79d4-7gvq4_50009fb1-1f2a-440a-9932-b5096012f9a4/metrics-server/0.log" Sep 08 13:45:49.427630 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.427595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzc54_490c5ed6-642d-4607-a0fc-8d3813f0fb2d/node-exporter/0.log" Sep 08 13:45:49.453488 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.453456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzc54_490c5ed6-642d-4607-a0fc-8d3813f0fb2d/kube-rbac-proxy/0.log" Sep 08 13:45:49.483208 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.483179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzc54_490c5ed6-642d-4607-a0fc-8d3813f0fb2d/init-textfile/0.log" Sep 08 13:45:49.925514 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.925478 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f5f58b9cf-pv6f5_7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b/telemeter-client/0.log" Sep 08 13:45:49.955459 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.955421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f5f58b9cf-pv6f5_7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b/reload/0.log" Sep 08 13:45:49.989939 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:49.989887 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f5f58b9cf-pv6f5_7389c0b0-bd0e-40d4-b6ff-64ebf8a1664b/kube-rbac-proxy/0.log" Sep 08 13:45:50.041832 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.041803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/thanos-query/0.log" Sep 08 13:45:50.071181 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.071148 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/kube-rbac-proxy-web/0.log" Sep 08 13:45:50.112944 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.112891 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/kube-rbac-proxy/0.log" Sep 08 13:45:50.142152 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.142120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/prom-label-proxy/0.log" Sep 08 13:45:50.171724 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.171696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/kube-rbac-proxy-rules/0.log" Sep 08 13:45:50.203032 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:50.202951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96b7994c4-4jcms_1a25c1a7-22aa-49f3-9ca4-fed175f0eb09/kube-rbac-proxy-metrics/0.log" Sep 08 13:45:51.477205 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:51.477167 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-vh49l_a08dca9c-b007-44e2-9183-a296400a0c8e/networking-console-plugin/0.log" Sep 08 13:45:52.084660 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:52.084618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/2.log" Sep 08 13:45:52.091516 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:52.091478 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8r56t_f743df81-995e-4b99-ab12-fe20e7f3439c/console-operator/3.log" Sep 08 13:45:52.577576 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:52.577535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77b46778c8-cz4s6_73d33780-6534-4b8c-ad5d-28634043bf2f/console/0.log" Sep 08 13:45:52.668261 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:52.668223 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-q65r7_ef6a973e-37ee-48e1-ae44-52b981f41ecd/download-server/0.log" Sep 08 13:45:53.002860 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.002815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj"] Sep 08 13:45:53.003336 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.003314 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" Sep 08 13:45:53.003336 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.003337 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" Sep 08 13:45:53.003505 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.003450 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fe5d6f-4377-4ece-afbc-eeaf4abc7efd" containerName="model-chainer-raw-hpa-90436" Sep 08 13:45:53.006700 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.006677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.009209 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.009188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7425\"/\"kube-root-ca.crt\"" Sep 08 13:45:53.010141 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.010126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r7425\"/\"default-dockercfg-zfwhh\"" Sep 08 13:45:53.010371 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.010355 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7425\"/\"openshift-service-ca.crt\"" Sep 08 13:45:53.025445 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.025416 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj"] Sep 08 13:45:53.129415 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.129367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-sys\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.129415 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.129412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-proc\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.129661 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.129448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-lib-modules\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.129661 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.129473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgjh4\" (UniqueName: \"kubernetes.io/projected/69562700-6a61-40a0-9869-6a3fbdb45bde-kube-api-access-hgjh4\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.129661 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.129559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-podres\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.230895 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.230861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-podres\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.230931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-sys\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.230957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-proc\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.230990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-lib-modules\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.231007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgjh4\" (UniqueName: \"kubernetes.io/projected/69562700-6a61-40a0-9869-6a3fbdb45bde-kube-api-access-hgjh4\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.231009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-sys\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.231040 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-proc\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231114 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.231065 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-podres\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.231343 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.231131 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69562700-6a61-40a0-9869-6a3fbdb45bde-lib-modules\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.239994 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.239965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgjh4\" (UniqueName: \"kubernetes.io/projected/69562700-6a61-40a0-9869-6a3fbdb45bde-kube-api-access-hgjh4\") pod \"perf-node-gather-daemonset-ctzpj\" (UID: \"69562700-6a61-40a0-9869-6a3fbdb45bde\") " pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.312695 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.312606 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-89hl9_a693abd4-b6c1-4e97-adee-348f156174ce/volume-data-source-validator/0.log" Sep 08 13:45:53.317373 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.317346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:53.597764 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:53.597706 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj"] Sep 08 13:45:53.600343 ip-10-0-142-86 kubenswrapper[2576]: W0908 13:45:53.600314 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69562700_6a61_40a0_9869_6a3fbdb45bde.slice/crio-f0ce1130965f285c9b4ccb31f228dfe222b0570d854c5fec17472e8fd1e5e8ea WatchSource:0}: Error finding container f0ce1130965f285c9b4ccb31f228dfe222b0570d854c5fec17472e8fd1e5e8ea: Status 404 returned error can't find the container with id f0ce1130965f285c9b4ccb31f228dfe222b0570d854c5fec17472e8fd1e5e8ea Sep 08 13:45:54.305222 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.305185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" event={"ID":"69562700-6a61-40a0-9869-6a3fbdb45bde","Type":"ContainerStarted","Data":"d397b719f0b9c46bc142254fcea259855ad946444eaaf9556f499ec0a95a64dd"} Sep 08 13:45:54.305414 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.305236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" event={"ID":"69562700-6a61-40a0-9869-6a3fbdb45bde","Type":"ContainerStarted","Data":"f0ce1130965f285c9b4ccb31f228dfe222b0570d854c5fec17472e8fd1e5e8ea"} Sep 08 13:45:54.305414 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.305268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:45:54.324816 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.324761 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" podStartSLOduration=2.324743178 podStartE2EDuration="2.324743178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:45:54.32375409 +0000 UTC m=+1732.531412243" watchObservedRunningTime="2026-09-08 13:45:54.324743178 +0000 UTC m=+1732.532401274" Sep 08 13:45:54.511976 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.511944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgmb8_452ad9d2-8123-4e69-b2ff-3cad4a9d1a68/dns/0.log" Sep 08 13:45:54.553960 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.553925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgmb8_452ad9d2-8123-4e69-b2ff-3cad4a9d1a68/kube-rbac-proxy/0.log" Sep 08 13:45:54.639315 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:54.639227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxnqs_64e8eca3-fd82-42d5-8969-1f100287f790/dns-node-resolver/0.log" Sep 08 13:45:55.089183 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:55.089149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c8894c59c-m7zwh_2e0c3acd-b1bb-4d11-9abd-450b8acd45d5/registry/0.log" Sep 08 13:45:55.114955 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:55.114927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjht9_1c56b6bb-eb24-48b2-8951-b3cb14b77bdc/node-ca/0.log" Sep 08 13:45:56.422960 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:56.422897 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcczb_7da4995c-f237-4fe6-96d7-22ef1e437484/serve-healthcheck-canary/0.log" Sep 08 13:45:56.928124 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:56.928089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjjzt_80384edf-3336-482a-9854-48fe322ba4bd/kube-rbac-proxy/0.log" Sep 08 13:45:56.953869 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:56.953843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjjzt_80384edf-3336-482a-9854-48fe322ba4bd/exporter/0.log" Sep 08 13:45:56.981813 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:56.981777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjjzt_80384edf-3336-482a-9854-48fe322ba4bd/extractor/0.log" Sep 08 13:45:59.486727 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:59.486682 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-575d6764f4-bxgs8_e7b13c10-e2cc-4225-a64b-0d66cc26103e/manager/0.log" Sep 08 13:45:59.549279 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:59.549254 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-mh4bg_100f97c2-1a3d-4dcc-9674-31b210e98185/server/0.log" Sep 08 13:45:59.749724 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:59.749623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-jx5js_b3764d7e-5ec6-4af5-84a1-4931b5cbd7d5/manager/0.log" Sep 08 13:45:59.843963 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:45:59.843933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-9v798_8f7f99d0-1617-4101-8837-c863916f5f5a/seaweedfs/0.log" Sep 08 13:46:00.320177 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:00.320145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r7425/perf-node-gather-daemonset-ctzpj" Sep 08 13:46:04.361244 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:04.361212 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-qjk6p_3186c3ca-393a-411e-b01f-74404ad06e9e/migrator/0.log" Sep 08 13:46:04.383550 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:04.383523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-qjk6p_3186c3ca-393a-411e-b01f-74404ad06e9e/graceful-termination/0.log" Sep 08 13:46:04.729065 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:04.729030 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-tgkt6_e37e2b15-db0c-4ed6-a57e-50981ebd6199/kube-storage-version-migrator-operator/1.log" Sep 08 13:46:04.730690 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:04.730658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-tgkt6_e37e2b15-db0c-4ed6-a57e-50981ebd6199/kube-storage-version-migrator-operator/0.log" Sep 08 13:46:05.820658 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:05.820621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4rndf_b47451f9-07f2-4c1a-a703-25a40da89a5a/kube-multus/0.log" Sep 08 13:46:06.107834 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.107748 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/kube-multus-additional-cni-plugins/0.log" Sep 08 13:46:06.138879 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.138848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/egress-router-binary-copy/0.log" Sep 08 13:46:06.166374 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.166340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/cni-plugins/0.log" Sep 08 13:46:06.198436 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.198405 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/bond-cni-plugin/0.log" Sep 08 13:46:06.226315 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.226288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/routeoverride-cni/0.log" Sep 08 13:46:06.252380 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.252347 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/whereabouts-cni-bincopy/0.log" Sep 08 13:46:06.281611 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.281579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgq2l_2447a82f-ab9b-433e-9153-4c68c150b36a/whereabouts-cni/0.log" Sep 08 13:46:06.609648 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.609621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4sft_a788c6c8-4df9-4e8b-92b5-739e9d54723f/network-metrics-daemon/0.log" Sep 08 13:46:06.633285 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:06.633250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4sft_a788c6c8-4df9-4e8b-92b5-739e9d54723f/kube-rbac-proxy/0.log" Sep 08 13:46:07.763751 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.763718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-controller/0.log" Sep 08 13:46:07.784197 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.784166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/0.log" Sep 08 13:46:07.784372 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.784163 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovn-acl-logging/1.log" Sep 08 13:46:07.809563 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.809527 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/kube-rbac-proxy-node/0.log" Sep 08 13:46:07.833754 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.833726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 13:46:07.852129 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.852100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/northd/0.log" Sep 08 13:46:07.874844 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.874806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/nbdb/0.log" Sep 08 13:46:07.897715 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.897687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/sbdb/0.log" Sep 08 13:46:07.952307 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:07.952271 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvm89_263e761f-f62d-4a21-a3fc-ae988ab70137/ovnkube-controller/0.log" Sep 08 13:46:09.249573 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:09.249541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-dwf8v_3e355470-4b4b-4b19-9816-3700352d3df2/check-endpoints/0.log" Sep 08 13:46:09.325195 ip-10-0-142-86 kubenswrapper[2576]: I0908 13:46:09.325154 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vxxgm_79336fc4-e089-4c83-89f5-b7259adec138/network-check-target-container/0.log"