Sep 09 23:46:02.273322 ip-10-0-142-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:46:02.273338 ip-10-0-142-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:46:02.273348 ip-10-0-142-137 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:46:02.273700 ip-10-0-142-137 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:46:12.095767 ip-10-0-142-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 09 23:46:12.095777 ip-10-0-142-137 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d69e1b783f204a2d8e232bcd15a1a7a9 -- Sep 09 23:47:45.151075 ip-10-0-142-137 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:47:45.575540 ip-10-0-142-137 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:47:45.575540 ip-10-0-142-137 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:47:45.575540 ip-10-0-142-137 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:47:45.575540 ip-10-0-142-137 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:47:45.575540 ip-10-0-142-137 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:47:45.576567 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.576468 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:47:45.579694 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579673 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.579694 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579689 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.579694 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579694 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.579694 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579700 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579704 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579709 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579713 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579717 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579721 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579725 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579729 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579733 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579737 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579741 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579745 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579749 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579752 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579769 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579774 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579778 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579782 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579788 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579793 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.579954 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579817 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579822 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579826 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579830 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579834 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579846 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579852 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579856 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579860 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579864 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579867 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579871 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579876 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579879 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579884 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579889 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579894 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579898 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579903 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579907 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.580729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579911 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579915 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579919 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579923 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579928 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579932 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579936 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.579996 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580061 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580069 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580077 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580082 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580087 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580091 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580096 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.581292 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580101 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.580106 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581425 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581560 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581572 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581576 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581579 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581582 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581585 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581590 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581593 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581596 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581602 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581605 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581608 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581611 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581614 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581616 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581619 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581622 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.581816 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581624 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581627 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581630 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581633 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581637 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581641 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581644 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581647 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581650 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581652 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581655 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581658 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581661 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581664 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581666 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581669 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581672 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581675 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581677 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.582319 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581680 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.581683 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582397 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582404 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582406 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582410 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582413 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582416 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582419 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582422 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582424 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582427 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582430 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582432 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582435 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582437 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582442 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582447 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582450 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.582777 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582453 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582456 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582459 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582461 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582464 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582467 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582470 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582472 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582475 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582478 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582480 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582483 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582485 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582488 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582490 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582494 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582496 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582499 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582502 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582505 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.583265 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582507 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582510 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582512 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582515 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582517 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582520 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582522 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582525 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582527 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582530 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582533 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582535 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582538 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582540 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582543 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582547 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582549 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582552 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582554 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582557 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.583810 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582559 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582562 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582564 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582567 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582570 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582572 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582575 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582578 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582581 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582583 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582587 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582590 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582592 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582595 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582597 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582600 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582603 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582605 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582608 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582611 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.584305 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582613 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582616 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582619 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582623 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582626 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582631 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582635 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582639 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582642 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582645 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582648 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582652 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582654 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582657 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582659 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582662 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582664 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582667 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582670 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.584815 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582673 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582676 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.582679 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583045 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583051 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583053 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583056 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583059 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583062 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583064 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583067 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583070 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583072 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583075 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583078 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583081 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583084 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583086 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583089 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583091 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.585302 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583094 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583096 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583099 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583101 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583104 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583106 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583111 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583114 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583117 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583120 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583122 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583125 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583129 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583132 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583134 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583137 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583140 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583142 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583145 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.585776 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583148 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583150 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583153 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583155 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583158 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583160 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583163 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583166 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583170 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583172 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583175 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583178 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583181 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583184 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583187 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583190 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583192 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583196 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583198 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.586243 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583201 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583204 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583207 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583209 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583212 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583215 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583218 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583221 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583223 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583226 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583229 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583232 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583235 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583237 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583240 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583242 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583245 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583247 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583250 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583252 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.586719 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583255 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583257 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583260 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583265 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583268 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583271 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583274 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583278 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583280 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583283 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583285 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583288 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583290 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583293 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583296 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583298 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583301 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583304 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583307 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583309 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.587219 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583312 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583314 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583317 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.583319 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583392 2572 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583427 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583432 2572 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583436 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583440 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583444 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583448 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583452 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583455 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583458 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583461 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583464 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583467 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583470 2572 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583473 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583476 2572 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583478 2572 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583482 2572 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583487 2572 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:47:45.587703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583490 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583493 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583496 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583499 2572 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583502 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583505 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583508 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583512 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583515 2572 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583518 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583521 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583524 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583527 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583531 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583535 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583538 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583540 2572 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583543 2572 flags.go:64] FLAG: --enable-server="true" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583546 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583550 2572 flags.go:64] FLAG: --event-burst="100" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583553 2572 flags.go:64] FLAG: --event-qps="50" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583556 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583559 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583562 2572 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:47:45.588308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583565 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583568 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583571 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583573 2572 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583576 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583579 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583582 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583585 2572 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583587 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583590 2572 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583593 2572 flags.go:64] FLAG: --feature-gates="" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583596 2572 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583602 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583605 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583608 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583612 2572 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583615 2572 flags.go:64] FLAG: --help="false" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583618 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583621 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583624 2572 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583627 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583630 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583633 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583637 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:47:45.589006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583640 2572 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583642 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583645 2572 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583648 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583651 2572 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583654 2572 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583657 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583660 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583663 2572 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583665 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583668 2572 flags.go:64] FLAG: --lock-file="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583671 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583674 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583676 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583681 2572 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583684 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583687 2572 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583690 2572 flags.go:64] FLAG: --logging-format="text" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583692 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583695 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583700 2572 flags.go:64] FLAG: --manifest-url="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583702 2572 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583707 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583710 2572 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583713 2572 flags.go:64] FLAG: --max-pods="110" Sep 09 23:47:45.589656 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583716 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583719 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583722 2572 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583725 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583728 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583730 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583733 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583741 2572 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583744 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583747 2572 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583749 2572 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583752 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583757 2572 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583759 2572 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583763 2572 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583765 2572 flags.go:64] FLAG: --port="10250" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583768 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583771 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e7507c4ec5f1dded" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583774 2572 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583777 2572 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583780 2572 flags.go:64] FLAG: --register-node="true" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583783 2572 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583787 2572 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583789 2572 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:47:45.590308 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583792 2572 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583808 2572 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583812 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583816 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583821 2572 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583824 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583827 2572 flags.go:64] FLAG: --runonce="false" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583830 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583833 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583836 2572 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583839 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583841 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583844 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583847 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583850 2572 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583852 2572 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583856 2572 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583858 2572 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583861 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583864 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583867 2572 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583870 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583875 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583877 2572 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583880 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:47:45.590925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583884 2572 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583887 2572 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583889 2572 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583892 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583895 2572 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583898 2572 flags.go:64] FLAG: --v="2" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583906 2572 flags.go:64] FLAG: --version="false" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583910 2572 flags.go:64] FLAG: --vmodule="" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583914 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.583917 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584051 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584056 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584059 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584062 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584066 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584068 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584071 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584073 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584076 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584078 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584081 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.591565 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584083 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584086 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584088 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584091 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584094 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584096 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584100 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584104 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584107 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584110 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584112 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584115 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584118 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584121 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584124 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584126 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584129 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584132 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584134 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.592122 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584137 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584139 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584142 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584146 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584149 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584153 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584156 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584158 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584161 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584164 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584166 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584169 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584172 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584174 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584177 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584180 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584182 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584185 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584188 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584190 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.592586 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584193 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584195 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584198 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584200 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584203 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584205 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584208 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584210 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584214 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584218 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584221 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584224 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584226 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584229 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584231 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584235 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584238 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584244 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584246 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584249 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.593115 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584251 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584255 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584259 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584262 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584265 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584268 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584270 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584272 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584275 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584278 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584280 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584283 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584285 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584288 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584290 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584293 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584296 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584298 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584301 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584303 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.593600 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584306 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584308 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584311 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584314 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584316 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584319 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584322 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584326 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.584329 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.585099 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.593491 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.593506 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.593519 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.593524 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593587 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.594199 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593592 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593595 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593598 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593601 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593605 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593608 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593611 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593614 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593617 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593620 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593623 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593626 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593628 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593633 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593636 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593640 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593643 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593646 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593649 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593651 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.594579 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593655 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593657 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593660 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593663 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593666 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593669 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593671 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593674 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593678 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593682 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593685 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593687 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593690 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593693 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593696 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593699 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593701 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593704 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593707 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593709 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.595282 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593712 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593714 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593717 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593720 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593722 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593725 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593728 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593730 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593733 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593736 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593740 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593744 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593748 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593751 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593754 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593757 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593760 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593763 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593766 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.596227 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593768 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593772 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593775 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593778 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593780 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593783 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593785 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593788 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593791 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593793 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593811 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593815 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593818 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593820 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593823 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593826 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593828 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593831 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593834 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.597041 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593836 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593839 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593841 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593844 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593847 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593849 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593852 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593854 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593857 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593859 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593863 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593865 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593868 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593871 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593874 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593877 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593880 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593882 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593885 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.597848 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.593887 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.593893 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594378 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594385 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594388 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594391 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594394 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594396 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594399 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594402 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594404 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594407 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594410 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594413 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594416 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:47:45.598316 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594418 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594423 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594427 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594430 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594432 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594436 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594438 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594442 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594444 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594447 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594450 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594452 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594455 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594458 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594461 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594464 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594466 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594469 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594471 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594474 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:47:45.598697 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594477 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594479 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594482 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594485 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594487 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594490 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594492 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594495 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594499 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594503 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594506 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594509 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594511 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594514 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594517 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594520 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594522 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594525 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594527 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594530 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:47:45.599264 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594532 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594535 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594537 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594540 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594543 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594545 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594548 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594551 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594554 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594557 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594559 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594562 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594564 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594567 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594569 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594572 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594574 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594577 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594579 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:47:45.599750 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594583 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594587 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594590 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594594 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594597 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594599 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594602 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594605 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594608 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594610 2572 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594613 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594616 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594618 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594621 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594623 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594626 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594628 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594631 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594634 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594636 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:47:45.600234 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594639 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594642 2572 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594645 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594647 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594650 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594652 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:45.594655 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.594660 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.594754 2572 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.598610 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.600536 2572 server.go:1019] "Starting client certificate rotation" Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.600631 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:47:45.600735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.600663 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:47:45.603428 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.603415 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:47:45.608977 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.608963 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:47:45.618732 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.618711 2572 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:47:45.622086 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.622072 2572 log.go:25] "Validated CRI v1 image API" Sep 09 23:47:45.624748 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.624733 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:47:45.628126 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.628106 2572 fs.go:135] Filesystem UUIDs: map[16317dae-504e-4ee7-b2a2-cf91dc906e41:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 97cc9b00-0e48-4256-a173-4b93e5fca1e3:/dev/nvme0n1p3] Sep 09 23:47:45.628182 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.628125 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:47:45.630385 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.630367 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:47:45.634767 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.634660 2572 manager.go:216] Machine: {Timestamp:2026-09-09 23:47:45.633289727 +0000 UTC m=+0.374451156 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3141923 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cdfb232ae76b60062fbc848196d3b SystemUUID:ec2cdfb2-32ae-76b6-0062-fbc848196d3b BootID:d69e1b78-3f20-4a2d-8e23-2bcd15a1a7a9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c9:4c:16:07:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c9:4c:16:07:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:10:99:dc:ef:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:47:45.634767 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.634762 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:47:45.634893 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.634843 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:47:45.638403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.638378 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:47:45.638538 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.638407 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:47:45.639284 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.639274 2572 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:47:45.639323 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.639287 2572 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:47:45.639323 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.639295 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:47:45.639920 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.639910 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:47:45.641917 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.641907 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:47:45.645452 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645441 2572 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:47:45.645562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645553 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:47:45.645596 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645588 2572 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:47:45.645623 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645602 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:47:45.645623 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645616 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:47:45.645676 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645625 2572 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:47:45.645676 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.645635 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:47:45.646101 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.646088 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:47:45.646142 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.646111 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:47:45.648386 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.648365 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:47:45.651663 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651648 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:47:45.651703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651681 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:47:45.651883 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651872 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:47:45.651921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651888 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:47:45.651921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651894 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:47:45.651921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651900 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:47:45.651921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651909 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:47:45.651921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.651919 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:47:45.652484 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652476 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:47:45.652513 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652485 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:47:45.652513 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652498 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:47:45.652513 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652503 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:47:45.652591 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652515 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:47:45.652591 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.652523 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:47:45.653370 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.653361 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:47:45.653402 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.653371 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:47:45.656566 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.656551 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:47:45.656601 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.656551 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:47:45.656630 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.656566 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:47:45.657715 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.657701 2572 server.go:1268] "Started kubelet" Sep 09 23:47:45.657767 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.657737 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:47:45.657873 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.657835 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:47:45.657918 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.657890 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:47:45.661741 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.661718 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:47:45.662071 ip-10-0-142-137 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:47:45.663327 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.663301 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:47:45.664601 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.664506 2572 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:47:45.668836 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.668724 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:47:45.668836 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.668731 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:47:45.668836 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.668828 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:45.669572 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.669557 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:47:45.669572 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.669571 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:47:45.670757 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.668261 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-137.ec2.internal.18d3cbe5fd8715e0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-137.ec2.internal,UID:ip-10-0-142-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-137.ec2.internal,},FirstTimestamp:2026-09-09 23:47:45.6576568 +0000 UTC m=+0.398818224,LastTimestamp:2026-09-09 23:47:45.6576568 +0000 UTC m=+0.398818224,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-137.ec2.internal,}" Sep 09 23:47:45.670889 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.670829 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:47:45.671073 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671057 2572 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:47:45.671073 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671073 2572 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:47:45.671185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671111 2572 factory.go:55] Registering systemd factory Sep 09 23:47:45.671185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671125 2572 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:47:45.671353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671336 2572 factory.go:153] Registering CRI-O factory Sep 09 23:47:45.671353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671354 2572 factory.go:223] Registration of the crio container factory successfully Sep 09 23:47:45.671501 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671424 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:47:45.671501 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671448 2572 factory.go:103] Registering Raw factory Sep 09 23:47:45.671501 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671463 2572 manager.go:1196] Started watching for new ooms in manager Sep 09 23:47:45.671946 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.671934 2572 manager.go:349] Starting recovery of all containers Sep 09 23:47:45.676531 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.676510 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6dwl2" Sep 09 23:47:45.677046 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.677026 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 23:47:45.677148 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.677113 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 23:47:45.682692 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.682673 2572 manager.go:354] Recovery completed Sep 09 23:47:45.684470 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.684448 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6dwl2" Sep 09 23:47:45.687276 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.687265 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.689471 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.689452 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.689552 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.689488 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.689552 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.689504 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.690522 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.690507 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:47:45.690522 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.690518 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:47:45.690653 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.690524 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.690653 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.690532 2572 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:47:45.691283 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691265 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.691366 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691295 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.691366 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691305 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.691718 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691703 2572 policy_none.go:49] "None policy: Start" Sep 09 23:47:45.691778 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691722 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:47:45.691778 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.691736 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:47:45.692152 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.692086 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-137.ec2.internal.18d3cbe5ff6c8508 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-137.ec2.internal,UID:ip-10-0-142-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-137.ec2.internal,},FirstTimestamp:2026-09-09 23:47:45.689470216 +0000 UTC m=+0.430631641,LastTimestamp:2026-09-09 23:47:45.689470216 +0000 UTC m=+0.430631641,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-137.ec2.internal,}" Sep 09 23:47:45.692757 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.692740 2572 policy_none.go:47] "Start" Sep 09 23:47:45.716759 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.716744 2572 manager.go:337] "Starting Device Plugin manager" Sep 09 23:47:45.716850 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.716777 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:47:45.716850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.716786 2572 server.go:87] "Starting device plugin registration server" Sep 09 23:47:45.717011 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.716998 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:47:45.717057 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.717012 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:47:45.717143 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.717127 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:47:45.717211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.717200 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:47:45.717256 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.717211 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:47:45.717761 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.717738 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:47:45.717860 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.717793 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:45.770766 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.770741 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:47:45.771907 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.771892 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:47:45.771977 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.771934 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:47:45.771977 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.771951 2572 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:47:45.772060 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.772014 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:47:45.774115 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.774095 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:45.817949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.817930 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.818694 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.818680 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.818755 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.818707 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.818755 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.818717 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.818755 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.818736 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.825174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.825160 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.825243 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.825180 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-137.ec2.internal\": node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:45.853521 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.853470 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:45.872826 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.872783 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal"] Sep 09 23:47:45.872883 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.872866 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.874213 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.874199 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.874274 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.874224 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.874274 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.874234 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.875311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.875300 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.875463 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.875451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.875499 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.875478 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.876097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876082 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.876159 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876110 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.876159 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876119 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.876229 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876086 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.876229 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876188 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.876229 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.876203 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.877285 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.877269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.877346 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.877301 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:47:45.878487 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.878470 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:47:45.878556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.878500 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:47:45.878556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.878510 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:47:45.908394 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.908376 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-137.ec2.internal\" not found" node="ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.911698 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.911684 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-137.ec2.internal\" not found" node="ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.953709 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:45.953690 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:45.971764 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.971745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.971858 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.971768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:45.971858 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:45.971785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be7ae5f8aa68bc3268930762bd5fa5d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-137.ec2.internal\" (UID: \"2be7ae5f8aa68bc3268930762bd5fa5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.053906 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.053889 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:46.072290 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be7ae5f8aa68bc3268930762bd5fa5d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-137.ec2.internal\" (UID: \"2be7ae5f8aa68bc3268930762bd5fa5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.072353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.072353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.072353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072348 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.072475 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be7ae5f8aa68bc3268930762bd5fa5d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-137.ec2.internal\" (UID: \"2be7ae5f8aa68bc3268930762bd5fa5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.072475 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.072394 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc15afe5ce8fdebd038716c648816a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal\" (UID: \"fc15afe5ce8fdebd038716c648816a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.154708 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.154667 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:46.212187 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.212164 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.214851 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.214840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.255222 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.255201 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:46.355809 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.355782 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:46.456902 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.456830 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-137.ec2.internal\" not found" Sep 09 23:47:46.479737 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.479708 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:46.569494 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.569477 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.577535 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.577513 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:47:46.579238 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.579207 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" Sep 09 23:47:46.590844 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.590824 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:47:46.600733 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.600717 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:47:46.600861 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.600835 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:47:46.600911 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.600858 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:47:46.648561 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.648541 2572 apiserver.go:52] "Watching apiserver" Sep 09 23:47:46.665423 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.665404 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:47:46.665797 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.665776 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8j4qg","kube-system/global-pull-secret-syncer-v2dpx","openshift-image-registry/node-ca-8fvsj","openshift-multus/multus-additional-cni-plugins-w4j49","openshift-network-diagnostics/network-check-target-j4jx9","openshift-network-operator/iptables-alerter-84jkl","openshift-ovn-kubernetes/ovnkube-node-std7w","kube-system/konnectivity-agent-mnt9f","kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l","openshift-cluster-node-tuning-operator/tuned-px5k2","openshift-dns/node-resolver-cltlp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal","openshift-multus/multus-mh8gg"] Sep 09 23:47:46.667153 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.667125 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.668297 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.668276 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.669149 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.668800 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:47:46.670769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.669367 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8m9v2\"" Sep 09 23:47:46.670769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.669812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.670769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.670132 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.670769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.670145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.671020 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.670773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:47:46.671122 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.671104 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:47:46.671286 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.671267 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.672324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.671523 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.672324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.672230 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2zgxn\"" Sep 09 23:47:46.672324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.672278 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.672674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.672655 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.672756 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.672697 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k4qng\"" Sep 09 23:47:46.672815 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.672800 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.673805 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.673788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:46.673942 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.673914 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:46.674730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.674705 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:47:46.674903 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.674866 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2dfnb\"" Sep 09 23:47:46.675110 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675088 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.675213 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:47:46.675323 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-modprobe-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-conf\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-tuned\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-socket-dir-parent\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-var-lib-kubelet\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675467 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-netns\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cni-binary-copy\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-bin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675565 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-hostroot\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-daemon-config\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-multus-certs\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675684 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-sys\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-lib-modules\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-system-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-k8s-cni-cncf-io\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.675850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-multus\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-systemd\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-run\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5768\" (UniqueName: \"kubernetes.io/projected/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-kube-api-access-n5768\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.675971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-hosts-file\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysconfig\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-host\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-tmp-dir\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cnibin\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676138 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5sk\" (UniqueName: \"kubernetes.io/projected/c73eea75-8d69-4bf2-a263-d4488cd4b24d-kube-api-access-7q5sk\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-tmp\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-conf-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-etc-kubernetes\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g756q\" (UniqueName: \"kubernetes.io/projected/71ed049b-dd35-4832-b59f-4d5f2e2795e6-kube-api-access-g756q\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcj6\" (UniqueName: \"kubernetes.io/projected/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-kube-api-access-flcj6\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-kubernetes\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cnibin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676370 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-kubelet\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-system-cni-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.676445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.676649 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.676446 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:46.677333 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.677313 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:47:46.677456 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.677441 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.677606 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.677590 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.678075 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.678052 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.678174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.678116 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmsx4\"" Sep 09 23:47:46.679130 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.679113 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:47:46.679482 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.679460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.679919 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.679629 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:47:46.680021 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.680010 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f9vgb\"" Sep 09 23:47:46.680082 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.680046 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:47:46.681041 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.681433 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681415 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:47:46.681823 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681775 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:47:46.681922 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:47:46.681922 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.682097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.681957 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:47:46.682097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.682012 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-75mhr\"" Sep 09 23:47:46.682097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.682069 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.682433 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.682416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.683201 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.683181 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggwdm\"" Sep 09 23:47:46.683201 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.683192 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.683349 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.683259 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:47:46.683478 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.683465 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.683906 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.683888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.683981 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.683959 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:46.686129 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.686074 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:42:46 +0000 UTC" deadline="2028-05-21 03:13:09.442140862 +0000 UTC" Sep 09 23:47:46.686129 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.686126 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14859h25m22.756019502s" Sep 09 23:47:46.686497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.686479 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:47:46.686585 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.686516 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:47:46.687204 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.687186 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:47:46.687546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.687531 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75hrj\"" Sep 09 23:47:46.705997 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.705978 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2q7p" Sep 09 23:47:46.717457 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.717441 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2q7p" Sep 09 23:47:46.771865 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.771841 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:47:46.776833 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-conf\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.776921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-tuned\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.776921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.776921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-socket-dir-parent\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.776921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-konnectivity-ca\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-log-socket\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-var-lib-kubelet\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-socket-dir-parent\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.776999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-var-lib-kubelet\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91908aac-1c5f-4654-9e20-46fcb13a8b40-host\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777124 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-conf\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.777144 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cni-binary-copy\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-daemon-config\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777215 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-registration-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-iptables-alerter-script\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777330 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vlc5\" (UniqueName: \"kubernetes.io/projected/91908aac-1c5f-4654-9e20-46fcb13a8b40-kube-api-access-8vlc5\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg4qw\" (UniqueName: \"kubernetes.io/projected/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-kube-api-access-bg4qw\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-systemd-units\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-node-log\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-sys\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.777546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-lib-modules\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-sys-fs\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777592 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-kubelet-config\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-sys\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-bin\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-lib-modules\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-netd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-env-overrides\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-script-lib\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-multus\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cni-binary-copy\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-daemon-config\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-run\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777793 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-multus\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5768\" (UniqueName: \"kubernetes.io/projected/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-kube-api-access-n5768\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777837 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-run\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.778089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-slash\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0183007c-8422-420d-81bd-ffb8f5402c74-ovn-node-metrics-cert\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysconfig\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-host\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.777987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5sk\" (UniqueName: \"kubernetes.io/projected/c73eea75-8d69-4bf2-a263-d4488cd4b24d-kube-api-access-7q5sk\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778016 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysconfig\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-dbus\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778083 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-host\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-conf-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g756q\" (UniqueName: \"kubernetes.io/projected/71ed049b-dd35-4832-b59f-4d5f2e2795e6-kube-api-access-g756q\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcj6\" (UniqueName: \"kubernetes.io/projected/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-kube-api-access-flcj6\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778159 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-multus-conf-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91908aac-1c5f-4654-9e20-46fcb13a8b40-serviceca\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778177 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-sysctl-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.778949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778329 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-kubelet\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-kubernetes\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cnibin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-ovn\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778479 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-kubernetes\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-config\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-modprobe-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778532 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-cnibin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-host-slash\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sd8c\" (UniqueName: \"kubernetes.io/projected/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-kube-api-access-5sd8c\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-modprobe-d\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-netns\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778663 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-netns\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.779818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-agent-certs\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-bin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-hostroot\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-hostroot\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-cni-bin\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-multus-certs\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-var-lib-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-multus-certs\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd746\" (UniqueName: \"kubernetes.io/projected/0183007c-8422-420d-81bd-ffb8f5402c74-kube-api-access-vd746\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.778987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-system-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-k8s-cni-cncf-io\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779054 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-system-cni-dir\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-device-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.780628 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-run-k8s-cni-cncf-io\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-systemd\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-hosts-file\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779210 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-tmp-dir\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cnibin\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779246 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-systemd\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-socket-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779302 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cnibin\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-netns\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-systemd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-etc-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-hosts-file\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-tmp\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-etc-kubernetes\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-kubelet\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.781174 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779475 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-etc-kubernetes\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-system-cni-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779498 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-tmp-dir\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xg2q\" (UniqueName: \"kubernetes.io/projected/034b7f05-a135-4df4-a1dc-050559745867-kube-api-access-2xg2q\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71ed049b-dd35-4832-b59f-4d5f2e2795e6-host-var-lib-kubelet\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c73eea75-8d69-4bf2-a263-d4488cd4b24d-system-cni-dir\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.779962 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c73eea75-8d69-4bf2-a263-d4488cd4b24d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.780712 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-etc-tuned\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.781706 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.781353 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-tmp\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.784463 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.784444 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:46.786727 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.786707 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g756q\" (UniqueName: \"kubernetes.io/projected/71ed049b-dd35-4832-b59f-4d5f2e2795e6-kube-api-access-g756q\") pod \"multus-mh8gg\" (UID: \"71ed049b-dd35-4832-b59f-4d5f2e2795e6\") " pod="openshift-multus/multus-mh8gg" Sep 09 23:47:46.786813 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.786759 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5sk\" (UniqueName: \"kubernetes.io/projected/c73eea75-8d69-4bf2-a263-d4488cd4b24d-kube-api-access-7q5sk\") pod \"multus-additional-cni-plugins-w4j49\" (UID: \"c73eea75-8d69-4bf2-a263-d4488cd4b24d\") " pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:46.786813 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.786768 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5768\" (UniqueName: \"kubernetes.io/projected/634e1708-b85b-4c5b-ab79-9e3bb2c03be9-kube-api-access-n5768\") pod \"tuned-px5k2\" (UID: \"634e1708-b85b-4c5b-ab79-9e3bb2c03be9\") " pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:46.787167 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.787146 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcj6\" (UniqueName: \"kubernetes.io/projected/ebc61ebf-eb92-49da-a2d3-5284a489e1b3-kube-api-access-flcj6\") pod \"node-resolver-cltlp\" (UID: \"ebc61ebf-eb92-49da-a2d3-5284a489e1b3\") " pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:46.879963 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.879945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-kubelet\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880024 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.879977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-ovn\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880024 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.879996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880024 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-config\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880068 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-kubelet\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880086 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-host-slash\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sd8c\" (UniqueName: \"kubernetes.io/projected/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-kube-api-access-5sd8c\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880068 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-ovn\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880160 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-host-slash\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-agent-certs\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.880211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-var-lib-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880220 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd746\" (UniqueName: \"kubernetes.io/projected/0183007c-8422-420d-81bd-ffb8f5402c74-kube-api-access-vd746\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-var-lib-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-device-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880336 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-socket-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880428 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-device-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.880432 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:46.880647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:46.881154 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-netns\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881154 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.880465 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-ovn-kubernetes\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881154 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-socket-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.881154 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.881067 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:47.38047777 +0000 UTC m=+2.121639196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:46.881422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881139 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-config\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-systemd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-etc-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881326 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-run-systemd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xg2q\" (UniqueName: \"kubernetes.io/projected/034b7f05-a135-4df4-a1dc-050559745867-kube-api-access-2xg2q\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.881674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881435 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-run-netns\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-konnectivity-ca\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.881674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-log-socket\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.881674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91908aac-1c5f-4654-9e20-46fcb13a8b40-host\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.881862 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-registration-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.881862 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-iptables-alerter-script\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.881862 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vlc5\" (UniqueName: \"kubernetes.io/projected/91908aac-1c5f-4654-9e20-46fcb13a8b40-kube-api-access-8vlc5\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.881862 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg4qw\" (UniqueName: \"kubernetes.io/projected/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-kube-api-access-bg4qw\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-systemd-units\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-node-log\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.881954 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-sys-fs\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-kubelet-config\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-bin\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882116 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882109 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91908aac-1c5f-4654-9e20-46fcb13a8b40-host\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-netd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-env-overrides\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-script-lib\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882190 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-registration-dir\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-slash\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0183007c-8422-420d-81bd-ffb8f5402c74-ovn-node-metrics-cert\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-dbus\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91908aac-1c5f-4654-9e20-46fcb13a8b40-serviceca\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.882426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.882919 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.882569 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:46.882919 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.882642 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:47:47.382621214 +0000 UTC m=+2.123782643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:46.882919 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882769 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-iptables-alerter-script\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.882919 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882844 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-netd\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.883114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882928 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-systemd-units\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.883114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.882985 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-node-log\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.883114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883049 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-sys-fs\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.883256 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-kubelet-config\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.883256 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883163 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-log-socket\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883441 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-cni-bin\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883510 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-host-slash\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883712 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0183007c-8422-420d-81bd-ffb8f5402c74-etc-openvswitch\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883795 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/034b7f05-a135-4df4-a1dc-050559745867-etc-selinux\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.883863 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/572a8f87-4f72-4cd1-917d-53e18972aa49-dbus\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.884073 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-agent-certs\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.884161 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.884105 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-env-overrides\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.885491 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.884226 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0183007c-8422-420d-81bd-ffb8f5402c74-ovnkube-script-lib\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.885491 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.884281 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d61c0dba-e1c6-4cad-a111-f19a5d9471f7-konnectivity-ca\") pod \"konnectivity-agent-mnt9f\" (UID: \"d61c0dba-e1c6-4cad-a111-f19a5d9471f7\") " pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:46.885491 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.884380 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91908aac-1c5f-4654-9e20-46fcb13a8b40-serviceca\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.886291 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.886269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0183007c-8422-420d-81bd-ffb8f5402c74-ovn-node-metrics-cert\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.888306 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.888283 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sd8c\" (UniqueName: \"kubernetes.io/projected/0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb-kube-api-access-5sd8c\") pod \"iptables-alerter-84jkl\" (UID: \"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb\") " pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:46.889938 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.889917 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd746\" (UniqueName: \"kubernetes.io/projected/0183007c-8422-420d-81bd-ffb8f5402c74-kube-api-access-vd746\") pod \"ovnkube-node-std7w\" (UID: \"0183007c-8422-420d-81bd-ffb8f5402c74\") " pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:46.890451 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.890434 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:47:46.890451 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.890453 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:47:46.890601 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.890466 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:46.890601 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:46.890561 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:47.390543989 +0000 UTC m=+2.131705407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:46.891657 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:46.891631 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be7ae5f8aa68bc3268930762bd5fa5d.slice/crio-9ff287593c2764316df205884906bbb146467867a270c657dc61c586252b9308 WatchSource:0}: Error finding container 9ff287593c2764316df205884906bbb146467867a270c657dc61c586252b9308: Status 404 returned error can't find the container with id 9ff287593c2764316df205884906bbb146467867a270c657dc61c586252b9308 Sep 09 23:47:46.892238 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:46.892219 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc15afe5ce8fdebd038716c648816a1f.slice/crio-56e718bb13cd591414d30989d177722559690c743fc1eff0c4665466346075c1 WatchSource:0}: Error finding container 56e718bb13cd591414d30989d177722559690c743fc1eff0c4665466346075c1: Status 404 returned error can't find the container with id 56e718bb13cd591414d30989d177722559690c743fc1eff0c4665466346075c1 Sep 09 23:47:46.896115 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.896082 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg4qw\" (UniqueName: \"kubernetes.io/projected/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-kube-api-access-bg4qw\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:46.898015 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.897995 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vlc5\" (UniqueName: \"kubernetes.io/projected/91908aac-1c5f-4654-9e20-46fcb13a8b40-kube-api-access-8vlc5\") pod \"node-ca-8fvsj\" (UID: \"91908aac-1c5f-4654-9e20-46fcb13a8b40\") " pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:46.898196 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.898176 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xg2q\" (UniqueName: \"kubernetes.io/projected/034b7f05-a135-4df4-a1dc-050559745867-kube-api-access-2xg2q\") pod \"aws-ebs-csi-driver-node-8nq7l\" (UID: \"034b7f05-a135-4df4-a1dc-050559745867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:46.899293 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.899279 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:47:46.927702 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.927680 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:46.992939 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:46.992890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-px5k2" Sep 09 23:47:47.002322 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.002297 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634e1708_b85b_4c5b_ab79_9e3bb2c03be9.slice/crio-394367b0f26b68c037b52c47ed8669806466007736b6cb5b21d6ac1cd3b68818 WatchSource:0}: Error finding container 394367b0f26b68c037b52c47ed8669806466007736b6cb5b21d6ac1cd3b68818: Status 404 returned error can't find the container with id 394367b0f26b68c037b52c47ed8669806466007736b6cb5b21d6ac1cd3b68818 Sep 09 23:47:47.016662 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.016640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh8gg" Sep 09 23:47:47.024267 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.024250 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ed049b_dd35_4832_b59f_4d5f2e2795e6.slice/crio-4cc02081a2fc1ee31c1667090fe9957a6da181102ceefe7c8e94dfce26245472 WatchSource:0}: Error finding container 4cc02081a2fc1ee31c1667090fe9957a6da181102ceefe7c8e94dfce26245472: Status 404 returned error can't find the container with id 4cc02081a2fc1ee31c1667090fe9957a6da181102ceefe7c8e94dfce26245472 Sep 09 23:47:47.036204 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.036185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cltlp" Sep 09 23:47:47.044189 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.044167 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc61ebf_eb92_49da_a2d3_5284a489e1b3.slice/crio-bc96bc79ac30007948880a99e234deb997ecb8647f19b0b3f5794bc584806ad9 WatchSource:0}: Error finding container bc96bc79ac30007948880a99e234deb997ecb8647f19b0b3f5794bc584806ad9: Status 404 returned error can't find the container with id bc96bc79ac30007948880a99e234deb997ecb8647f19b0b3f5794bc584806ad9 Sep 09 23:47:47.051364 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.051346 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w4j49" Sep 09 23:47:47.060127 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.060107 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73eea75_8d69_4bf2_a263_d4488cd4b24d.slice/crio-ae07cde88bb0b1ce1d51f7cd1b005321e91dd5d2016209ae00b62fa1f12a25ed WatchSource:0}: Error finding container ae07cde88bb0b1ce1d51f7cd1b005321e91dd5d2016209ae00b62fa1f12a25ed: Status 404 returned error can't find the container with id ae07cde88bb0b1ce1d51f7cd1b005321e91dd5d2016209ae00b62fa1f12a25ed Sep 09 23:47:47.068589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.068571 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84jkl" Sep 09 23:47:47.076151 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.076130 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eec67ef_856d_4cc7_87c9_a3b92f9f6ebb.slice/crio-cfe624411dd4a76df02918c7aef452994ab1ae9dbc02bbd52d29ee88aab1bb05 WatchSource:0}: Error finding container cfe624411dd4a76df02918c7aef452994ab1ae9dbc02bbd52d29ee88aab1bb05: Status 404 returned error can't find the container with id cfe624411dd4a76df02918c7aef452994ab1ae9dbc02bbd52d29ee88aab1bb05 Sep 09 23:47:47.081987 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.081967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:47:47.090949 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.090929 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61c0dba_e1c6_4cad_a111_f19a5d9471f7.slice/crio-352b71f719f6245c20b5d5f60bb98afa050ffd5a0acea8134a6f4305c96c254a WatchSource:0}: Error finding container 352b71f719f6245c20b5d5f60bb98afa050ffd5a0acea8134a6f4305c96c254a: Status 404 returned error can't find the container with id 352b71f719f6245c20b5d5f60bb98afa050ffd5a0acea8134a6f4305c96c254a Sep 09 23:47:47.103172 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.103151 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:47:47.111390 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.111371 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0183007c_8422_420d_81bd_ffb8f5402c74.slice/crio-44303c237b6b7ec02c6e06e525ab600c7974a44c75a83a8c7b3143659cd4e1db WatchSource:0}: Error finding container 44303c237b6b7ec02c6e06e525ab600c7974a44c75a83a8c7b3143659cd4e1db: Status 404 returned error can't find the container with id 44303c237b6b7ec02c6e06e525ab600c7974a44c75a83a8c7b3143659cd4e1db Sep 09 23:47:47.116985 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.116967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" Sep 09 23:47:47.122016 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.122000 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8fvsj" Sep 09 23:47:47.124752 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.124730 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034b7f05_a135_4df4_a1dc_050559745867.slice/crio-0332a3434e0da0d0cb58ae4567cc669cb857b56f762bfe39d6b585d06ea85852 WatchSource:0}: Error finding container 0332a3434e0da0d0cb58ae4567cc669cb857b56f762bfe39d6b585d06ea85852: Status 404 returned error can't find the container with id 0332a3434e0da0d0cb58ae4567cc669cb857b56f762bfe39d6b585d06ea85852 Sep 09 23:47:47.130252 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:47:47.130232 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91908aac_1c5f_4654_9e20_46fcb13a8b40.slice/crio-7ee2dfc383bf55075d24504cbfdf7580602c6fc6215c0de79d9514fe5c234e03 WatchSource:0}: Error finding container 7ee2dfc383bf55075d24504cbfdf7580602c6fc6215c0de79d9514fe5c234e03: Status 404 returned error can't find the container with id 7ee2dfc383bf55075d24504cbfdf7580602c6fc6215c0de79d9514fe5c234e03 Sep 09 23:47:47.385503 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.385408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:47.385503 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.385454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:47.385714 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.385579 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:47.385714 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.385638 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:48.385623337 +0000 UTC m=+3.126784776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:47.386027 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.385997 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:47.386138 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.386056 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:47:48.386039954 +0000 UTC m=+3.127201371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:47.485937 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.485895 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:47.486127 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.486072 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:47:47.486127 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.486093 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:47:47.486252 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.486133 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:47.486252 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.486205 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:48.486187637 +0000 UTC m=+3.227349054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:47.721299 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.721037 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:42:47 +0000 UTC" deadline="2028-05-03 13:54:45.844136477 +0000 UTC" Sep 09 23:47:47.721299 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.721107 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14438h6m58.123034645s" Sep 09 23:47:47.775135 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.775101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:47.775315 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:47.775238 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:47.790902 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.790833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84jkl" event={"ID":"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb","Type":"ContainerStarted","Data":"cfe624411dd4a76df02918c7aef452994ab1ae9dbc02bbd52d29ee88aab1bb05"} Sep 09 23:47:47.796249 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.796202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerStarted","Data":"ae07cde88bb0b1ce1d51f7cd1b005321e91dd5d2016209ae00b62fa1f12a25ed"} Sep 09 23:47:47.838119 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.838083 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cltlp" event={"ID":"ebc61ebf-eb92-49da-a2d3-5284a489e1b3","Type":"ContainerStarted","Data":"bc96bc79ac30007948880a99e234deb997ecb8647f19b0b3f5794bc584806ad9"} Sep 09 23:47:47.859723 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.859694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-px5k2" event={"ID":"634e1708-b85b-4c5b-ab79-9e3bb2c03be9","Type":"ContainerStarted","Data":"394367b0f26b68c037b52c47ed8669806466007736b6cb5b21d6ac1cd3b68818"} Sep 09 23:47:47.873772 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.873739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" event={"ID":"fc15afe5ce8fdebd038716c648816a1f","Type":"ContainerStarted","Data":"56e718bb13cd591414d30989d177722559690c743fc1eff0c4665466346075c1"} Sep 09 23:47:47.881651 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.881608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"44303c237b6b7ec02c6e06e525ab600c7974a44c75a83a8c7b3143659cd4e1db"} Sep 09 23:47:47.889045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.889020 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mnt9f" event={"ID":"d61c0dba-e1c6-4cad-a111-f19a5d9471f7","Type":"ContainerStarted","Data":"352b71f719f6245c20b5d5f60bb98afa050ffd5a0acea8134a6f4305c96c254a"} Sep 09 23:47:47.897676 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.897438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh8gg" event={"ID":"71ed049b-dd35-4832-b59f-4d5f2e2795e6","Type":"ContainerStarted","Data":"4cc02081a2fc1ee31c1667090fe9957a6da181102ceefe7c8e94dfce26245472"} Sep 09 23:47:47.908141 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.908117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" event={"ID":"2be7ae5f8aa68bc3268930762bd5fa5d","Type":"ContainerStarted","Data":"9ff287593c2764316df205884906bbb146467867a270c657dc61c586252b9308"} Sep 09 23:47:47.932028 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.932000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8fvsj" event={"ID":"91908aac-1c5f-4654-9e20-46fcb13a8b40","Type":"ContainerStarted","Data":"7ee2dfc383bf55075d24504cbfdf7580602c6fc6215c0de79d9514fe5c234e03"} Sep 09 23:47:47.947033 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:47.947006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" event={"ID":"034b7f05-a135-4df4-a1dc-050559745867","Type":"ContainerStarted","Data":"0332a3434e0da0d0cb58ae4567cc669cb857b56f762bfe39d6b585d06ea85852"} Sep 09 23:47:48.125546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.125468 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:48.214456 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.214425 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:47:48.406299 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.406191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:48.406299 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.406252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:48.406537 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.406368 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:48.406537 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.406432 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:50.406411843 +0000 UTC m=+5.147573261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:48.406856 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.406837 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:48.406953 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.406907 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:47:50.406890452 +0000 UTC m=+5.148051872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:48.507324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.507278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:48.507516 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.507500 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:47:48.507604 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.507528 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:47:48.507604 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.507541 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:48.507604 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.507597 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:50.507579446 +0000 UTC m=+5.248740864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:48.721791 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.721665 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:42:47 +0000 UTC" deadline="2028-03-20 17:18:01.585497193 +0000 UTC" Sep 09 23:47:48.721791 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.721730 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13385h30m12.863771515s" Sep 09 23:47:48.773216 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.773184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:48.773453 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.773330 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:48.773757 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:48.773731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:48.773862 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:48.773841 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:49.774033 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:49.774004 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:49.774501 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:49.774133 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:50.425582 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:50.425544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:50.425771 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:50.425652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:50.425836 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.425791 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:50.425919 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.425876 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:47:54.425854655 +0000 UTC m=+9.167016094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:50.426009 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.425993 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:50.426065 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.426048 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:54.426032324 +0000 UTC m=+9.167193740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:50.527535 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:50.526877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:50.527535 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.527071 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:47:50.527535 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.527097 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:47:50.527535 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.527110 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:50.527535 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.527167 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:47:54.527146911 +0000 UTC m=+9.268308343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:50.772689 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:50.772604 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:50.772689 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:50.772640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:50.772985 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.772759 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:50.773226 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:50.773200 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:51.772875 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:51.772841 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:51.773276 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:51.772951 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:52.772777 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:52.772731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:52.772977 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:52.772895 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:52.773358 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:52.773273 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:52.773422 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:52.773367 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:53.772689 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:53.772647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:53.772919 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:53.772806 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:54.461849 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:54.461745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:54.462297 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.461933 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:54.462297 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:54.461933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:54.462297 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.462009 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:54.462297 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.462016 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:48:02.461993087 +0000 UTC m=+17.203154523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:47:54.462297 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.462082 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:02.462064138 +0000 UTC m=+17.203225559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:47:54.562497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:54.562456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:54.562696 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.562673 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:47:54.562696 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.562695 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:47:54.562837 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.562711 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:54.562837 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.562773 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:02.562754166 +0000 UTC m=+17.303915599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:47:54.772703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:54.772623 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:54.772873 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.772762 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:54.773508 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:54.773173 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:54.773508 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:54.773284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:55.773413 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:55.773378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:55.773818 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:55.773501 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:56.773245 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:56.772852 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:56.773245 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:56.772966 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:56.773245 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:56.773004 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:56.773245 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:56.773137 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:57.772225 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:57.772192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:57.772416 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:57.772336 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:47:58.773069 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:58.773037 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:47:58.773069 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:58.773072 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:47:58.773544 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:58.773159 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:47:58.773544 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:58.773278 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:47:59.772487 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:47:59.772255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:47:59.772650 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:47:59.772542 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:00.772983 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:00.772946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:00.773400 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:00.772945 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:00.773400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:00.773081 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:00.773400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:00.773172 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:01.772200 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:01.772166 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:01.772381 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:01.772274 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:02.524995 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:02.524951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:02.525439 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:02.525048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:02.525439 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.525188 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:02.525439 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.525192 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:02.525439 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.525251 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:48:18.525232221 +0000 UTC m=+33.266393636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:02.525439 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.525269 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:18.525260944 +0000 UTC m=+33.266422357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:02.626063 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:02.626022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:02.626259 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.626161 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:02.626259 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.626185 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:02.626259 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.626198 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:02.626259 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.626257 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:18.626242712 +0000 UTC m=+33.367404124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:02.772858 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:02.772829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:02.773020 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:02.772872 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:02.773020 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.772956 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:02.773125 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:02.773071 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:03.772583 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:03.772553 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:03.773037 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:03.772671 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:04.772520 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:04.772480 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:04.772712 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:04.772491 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:04.772712 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:04.772632 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:04.772712 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:04.772686 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:05.773272 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:05.773238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:05.773635 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:05.773338 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:06.772741 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:06.772718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:06.772869 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:06.772852 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:06.772927 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:06.772907 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:06.773022 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:06.773003 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:07.010857 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.010826 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-px5k2" event={"ID":"634e1708-b85b-4c5b-ab79-9e3bb2c03be9","Type":"ContainerStarted","Data":"6d7cea0e8f3c0de6719caddd0b736fe83cef229ee1b6fb81f443ebe2dde0b94d"} Sep 09 23:48:07.016698 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.016674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"e014ad37d75a44604b42f9a740427eb08ca0d354e2f13fa0e666474a9c845a32"} Sep 09 23:48:07.018496 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.018474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" event={"ID":"2be7ae5f8aa68bc3268930762bd5fa5d","Type":"ContainerStarted","Data":"6ad88ccecb900d9c2155a2b8b3d73ff9f47297f50f053bbadfb6f0ac0f2415ca"} Sep 09 23:48:07.040394 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.040345 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-137.ec2.internal" podStartSLOduration=20.040328696 podStartE2EDuration="20.040328696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:07.039857733 +0000 UTC m=+21.781019166" watchObservedRunningTime="2026-09-09 23:48:07.040328696 +0000 UTC m=+21.781490132" Sep 09 23:48:07.040509 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.040486 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-px5k2" podStartSLOduration=1.372817776 podStartE2EDuration="21.040476632s" totalImagesPullingTime="19.667658856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:07.028467226 +0000 UTC m=+21.769628660" watchObservedRunningTime="2026-09-09 23:48:07.040476632 +0000 UTC m=+21.781638065" Sep 09 23:48:07.772895 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:07.772625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:07.773019 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:07.772963 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:08.021498 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.021466 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh8gg" event={"ID":"71ed049b-dd35-4832-b59f-4d5f2e2795e6","Type":"ContainerStarted","Data":"9e6dd242f10f51179a148ec623f0504d2306f0e8d115ee1223bceb91eb69c257"} Sep 09 23:48:08.022881 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.022860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8fvsj" event={"ID":"91908aac-1c5f-4654-9e20-46fcb13a8b40","Type":"ContainerStarted","Data":"3340f4156023ba3ccf40f0968b0b798b638d27eff893fd6317d0f758d5053f32"} Sep 09 23:48:08.024309 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.024267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" event={"ID":"034b7f05-a135-4df4-a1dc-050559745867","Type":"ContainerStarted","Data":"33e398d184d7ecf5ff04ed2d234da64ff41e7aa09c39344a65f74a4ff939c323"} Sep 09 23:48:08.025697 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.025678 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84jkl" event={"ID":"0eec67ef-856d-4cc7-87c9-a3b92f9f6ebb","Type":"ContainerStarted","Data":"b1a4ecbe76b0f527f062fb08786ed5fb67a4d5f7655f721bdf59fa9f02a71a23"} Sep 09 23:48:08.027081 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.027058 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="6de90d15a107e6c1c4bc850ca5ce32a46ecf97cd7cce16d270f06b00478a014e" exitCode=0 Sep 09 23:48:08.027152 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.027123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"6de90d15a107e6c1c4bc850ca5ce32a46ecf97cd7cce16d270f06b00478a014e"} Sep 09 23:48:08.028696 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.028674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cltlp" event={"ID":"ebc61ebf-eb92-49da-a2d3-5284a489e1b3","Type":"ContainerStarted","Data":"92bfae97005ed9d953bc6517ebcdc778fa3ee9d10a392f062e6055aea974ee2c"} Sep 09 23:48:08.030158 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.030138 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc15afe5ce8fdebd038716c648816a1f" containerID="3dcd620d4e5d95ce031a41299874418f94bac733e5337b3379c727b5bab55f71" exitCode=0 Sep 09 23:48:08.030258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.030205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" event={"ID":"fc15afe5ce8fdebd038716c648816a1f","Type":"ContainerDied","Data":"3dcd620d4e5d95ce031a41299874418f94bac733e5337b3379c727b5bab55f71"} Sep 09 23:48:08.033072 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033056 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:48:08.033375 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033358 2572 generic.go:356] "Generic (PLEG): container finished" podID="0183007c-8422-420d-81bd-ffb8f5402c74" containerID="85efb4feb8d72edfb982e30e663b3c35287887bb7ccba67760193103e46d5a13" exitCode=1 Sep 09 23:48:08.033438 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033424 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"78d57f517ace5d6da5a2e0369f70c681f03cebf05a839d0d49fc764872fbad1f"} Sep 09 23:48:08.033493 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"f9c5e9698d595b050781c2513d0f455233da8b475fa4e3e72720689ebcbbe2bd"} Sep 09 23:48:08.033546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033532 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"062e062e65c3ece0cb12e4ae1c526507592a076be6773a6979b4f50c5a2a9839"} Sep 09 23:48:08.033596 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033570 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"89313eb7ca9f5acddaee1f8216ee39f72e723b07cde64fefc2ab8dec03d3bfb9"} Sep 09 23:48:08.033642 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.033604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerDied","Data":"85efb4feb8d72edfb982e30e663b3c35287887bb7ccba67760193103e46d5a13"} Sep 09 23:48:08.034768 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.034745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mnt9f" event={"ID":"d61c0dba-e1c6-4cad-a111-f19a5d9471f7","Type":"ContainerStarted","Data":"08fa0b2d6edbd8f6761f725e8c3b9c58d1295d888790b0b3906c5c7529095f65"} Sep 09 23:48:08.037115 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.037084 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mh8gg" podStartSLOduration=2.025147647 podStartE2EDuration="22.037070355s" totalImagesPullingTime="20.011922708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:08.036983739 +0000 UTC m=+22.778145173" watchObservedRunningTime="2026-09-09 23:48:08.037070355 +0000 UTC m=+22.778231790" Sep 09 23:48:08.049213 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.049178 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84jkl" podStartSLOduration=2.485819722 podStartE2EDuration="22.049167772s" totalImagesPullingTime="19.56334805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:08.048732905 +0000 UTC m=+22.789894339" watchObservedRunningTime="2026-09-09 23:48:08.049167772 +0000 UTC m=+22.790329205" Sep 09 23:48:08.061459 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.061427 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mnt9f" podStartSLOduration=2.482826667 podStartE2EDuration="22.061415493s" totalImagesPullingTime="19.578588826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:08.060922155 +0000 UTC m=+22.802083589" watchObservedRunningTime="2026-09-09 23:48:08.061415493 +0000 UTC m=+22.802576926" Sep 09 23:48:08.084935 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.084912 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:48:08.085388 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.085366 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:48:08.103124 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.103047 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8fvsj" podStartSLOduration=1.5943273169999999 podStartE2EDuration="21.103032107s" totalImagesPullingTime="19.50870479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:08.08982715 +0000 UTC m=+22.830988585" watchObservedRunningTime="2026-09-09 23:48:08.103032107 +0000 UTC m=+22.844193542" Sep 09 23:48:08.103710 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.103670 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cltlp" podStartSLOduration=2.508891072 podStartE2EDuration="22.103660343s" totalImagesPullingTime="19.594769271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:08.103383162 +0000 UTC m=+22.844544600" watchObservedRunningTime="2026-09-09 23:48:08.103660343 +0000 UTC m=+22.844821778" Sep 09 23:48:08.760015 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.759994 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:48:08.772509 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.772489 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:08.772639 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:08.772616 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:08.772705 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:08.772656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:08.772774 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:08.772756 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:09.039189 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.039114 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" event={"ID":"fc15afe5ce8fdebd038716c648816a1f","Type":"ContainerStarted","Data":"cb9d567edcf320047133f184c05e11b004336d9286baec994a2d05972bb90b7b"} Sep 09 23:48:09.041639 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.041610 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" event={"ID":"034b7f05-a135-4df4-a1dc-050559745867","Type":"ContainerStarted","Data":"e35dfe2ff590c3e27897f3e801466412e7ea0cc2091dab9790a0b721dc54db4f"} Sep 09 23:48:09.042252 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.041823 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:48:09.042365 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.042307 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mnt9f" Sep 09 23:48:09.053919 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.053885 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-137.ec2.internal" podStartSLOduration=22.053872216 podStartE2EDuration="22.053872216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:09.053611142 +0000 UTC m=+23.794772587" watchObservedRunningTime="2026-09-09 23:48:09.053872216 +0000 UTC m=+23.795033650" Sep 09 23:48:09.730149 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.730005 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:48:08.760010967Z","UUID":"40292599-40b1-48c9-abe2-efedc3558cd4","Handler":null,"Name":"","Endpoint":""} Sep 09 23:48:09.731846 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.731821 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:48:09.731980 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.731859 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:48:09.772682 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:09.772652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:09.772820 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:09.772764 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:10.046985 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:10.046937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:48:10.047523 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:10.047488 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"a3c54553f41880ef7ad16b6f5c60c1429ab7c4b164b1a89ad41a1436d6146607"} Sep 09 23:48:10.772710 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:10.772539 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:10.772882 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:10.772609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:10.772882 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:10.772790 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:10.772989 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:10.772890 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:11.052189 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:11.052080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" event={"ID":"034b7f05-a135-4df4-a1dc-050559745867","Type":"ContainerStarted","Data":"4f391f2f43c11a6098ea0b5b98977b0933f21e1fe3a1d075bfe516dd9c3c04ee"} Sep 09 23:48:11.069755 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:11.069709 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8nq7l" podStartSLOduration=2.12122666 podStartE2EDuration="24.069691866s" totalImagesPullingTime="21.948465206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:11.069556776 +0000 UTC m=+25.810718211" watchObservedRunningTime="2026-09-09 23:48:11.069691866 +0000 UTC m=+25.810853292" Sep 09 23:48:11.773120 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:11.773086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:11.773254 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:11.773223 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:12.058973 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:12.058941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:48:12.059395 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:12.059362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"b59c72d1c3fbddb6c301a768b7008a5c0c38ea102beec8ce3c411c2c891e21d5"} Sep 09 23:48:12.059978 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:12.059955 2572 scope.go:117] "RemoveContainer" containerID="85efb4feb8d72edfb982e30e663b3c35287887bb7ccba67760193103e46d5a13" Sep 09 23:48:12.773335 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:12.773107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:12.773495 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:12.773184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:12.773495 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:12.773447 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:12.773618 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:12.773575 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:13.066336 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.066265 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:48:13.066713 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.066685 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" event={"ID":"0183007c-8422-420d-81bd-ffb8f5402c74","Type":"ContainerStarted","Data":"0597860e158afd3998010c97abedced3a10335b97ad7bf11003247accc1f08c0"} Sep 09 23:48:13.066910 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.066888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:13.067010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.066936 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:13.067010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.066975 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:13.084871 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.084759 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:13.085230 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.085207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:13.092589 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.092537 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" podStartSLOduration=6.507873308 podStartE2EDuration="26.092519099s" totalImagesPullingTime="19.584645791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:13.092148483 +0000 UTC m=+27.833309917" watchObservedRunningTime="2026-09-09 23:48:13.092519099 +0000 UTC m=+27.833680532" Sep 09 23:48:13.483912 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.483880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8j4qg"] Sep 09 23:48:13.484133 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.484012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:13.484206 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:13.484135 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:13.486559 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.486537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2dpx"] Sep 09 23:48:13.486674 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.486639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:13.486753 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:13.486726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:13.487304 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.487277 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j4jx9"] Sep 09 23:48:13.487400 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:13.487368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:13.487474 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:13.487446 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:14.773113 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:14.773043 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:14.773562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:14.773128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:14.773562 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:14.773133 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:14.773562 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:14.773209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:14.773562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:14.773219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:14.773562 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:14.773298 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:15.071842 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:15.071755 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="c717a2fd1ff307ce63abea3af6d272758296d78397d755a02442777288a1d42f" exitCode=0 Sep 09 23:48:15.072001 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:15.071837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"c717a2fd1ff307ce63abea3af6d272758296d78397d755a02442777288a1d42f"} Sep 09 23:48:16.772266 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:16.772102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:16.772737 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:16.772154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:16.772737 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:16.772328 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:16.772737 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:16.772157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:16.772737 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:16.772406 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:16.772737 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:16.772486 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:17.078251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:17.078177 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="65b76d27ef07f5fe43cf06e50699a35f6ef30e705c72972b2cd54fd2f746e4b1" exitCode=0 Sep 09 23:48:17.078382 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:17.078252 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"65b76d27ef07f5fe43cf06e50699a35f6ef30e705c72972b2cd54fd2f746e4b1"} Sep 09 23:48:18.560039 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.559981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:18.560339 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.560039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:18.560339 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.560113 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:18.560339 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.560123 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:18.560339 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.560170 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs podName:db5d618c-7cb8-4d74-8fe9-c1611be41dcd nodeName:}" failed. No retries permitted until 2026-09-09 23:48:50.560151744 +0000 UTC m=+65.301313171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs") pod "network-metrics-daemon-8j4qg" (UID: "db5d618c-7cb8-4d74-8fe9-c1611be41dcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:18.560339 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.560190 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret podName:572a8f87-4f72-4cd1-917d-53e18972aa49 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:50.560183253 +0000 UTC m=+65.301344665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret") pod "global-pull-secret-syncer-v2dpx" (UID: "572a8f87-4f72-4cd1-917d-53e18972aa49") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:18.661264 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.661237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:18.661364 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.661356 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:18.661400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.661367 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:18.661400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.661376 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7tfcm for pod openshift-network-diagnostics/network-check-target-j4jx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:18.661461 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.661415 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm podName:a8f14dc2-9352-4960-9249-c469f4671af8 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:50.661403876 +0000 UTC m=+65.402565287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tfcm" (UniqueName: "kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm") pod "network-check-target-j4jx9" (UID: "a8f14dc2-9352-4960-9249-c469f4671af8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:18.772289 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.772267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:18.772410 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.772396 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:18.772451 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:18.772407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:18.772451 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.772407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4jx9" podUID="a8f14dc2-9352-4960-9249-c469f4671af8" Sep 09 23:48:18.772517 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.772468 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2dpx" podUID="572a8f87-4f72-4cd1-917d-53e18972aa49" Sep 09 23:48:18.772555 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:18.772536 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8j4qg" podUID="db5d618c-7cb8-4d74-8fe9-c1611be41dcd" Sep 09 23:48:19.085242 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.085216 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="8cab8538e6da58f9b9aa02d97adb0b1554f4a1b46b38a96d1ddffc118b6fc540" exitCode=0 Sep 09 23:48:19.085386 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.085269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"8cab8538e6da58f9b9aa02d97adb0b1554f4a1b46b38a96d1ddffc118b6fc540"} Sep 09 23:48:19.911644 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.911618 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-137.ec2.internal" event="NodeReady" Sep 09 23:48:19.911988 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.911714 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:48:19.941995 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.941970 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk"] Sep 09 23:48:19.958684 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.958656 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:48:19.958914 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.958826 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:19.963439 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.963340 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 23:48:19.964376 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.963598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:19.965470 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.964634 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 23:48:19.965470 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.965136 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xdkv5\"" Sep 09 23:48:19.966365 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.965998 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:19.978687 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.978666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk"] Sep 09 23:48:19.978818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.978701 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5"] Sep 09 23:48:19.979002 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.978983 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:19.981626 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.981589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kmlm6\"" Sep 09 23:48:19.982272 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.982251 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:48:19.982784 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.982591 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:48:19.984105 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.983981 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:48:19.989059 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.989030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:48:19.996844 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.996789 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tk28q"] Sep 09 23:48:19.996988 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.996970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:19.999483 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.999460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 09 23:48:20.000100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.999511 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:20.000100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.999556 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:20.000100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:19.999709 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tf7hf\"" Sep 09 23:48:20.000264 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.000161 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 09 23:48:20.018945 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.018925 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt"] Sep 09 23:48:20.019040 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.019028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.021079 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.021059 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 09 23:48:20.021079 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.021070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9hlgd\"" Sep 09 23:48:20.021332 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.021316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 09 23:48:20.040830 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.040792 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6jffs"] Sep 09 23:48:20.040955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.040887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.043042 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 23:48:20.043138 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043054 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 23:48:20.043299 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043279 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 23:48:20.043394 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043344 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 23:48:20.043565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043547 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 23:48:20.043708 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043621 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 23:48:20.043778 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.043633 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 23:48:20.057157 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.057138 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk"] Sep 09 23:48:20.057845 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.057712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" Sep 09 23:48:20.062908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.060424 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p9vjn\"" Sep 09 23:48:20.062908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.060639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:48:20.062908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.060867 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:48:20.070535 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc5412-53b7-40f4-85f5-1962bd18251b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.070636 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070636 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070636 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070636 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070638 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjwj\" (UniqueName: \"kubernetes.io/projected/bcfc5412-53b7-40f4-85f5-1962bd18251b-kube-api-access-nkjwj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc5412-53b7-40f4-85f5-1962bd18251b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.070955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.070843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npm4f\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.086962 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.086941 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t"] Sep 09 23:48:20.087066 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.087050 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.089401 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.089384 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 09 23:48:20.109217 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.109194 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:48:20.109298 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.109222 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5"] Sep 09 23:48:20.109298 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.109238 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6f4s2"] Sep 09 23:48:20.109380 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.109344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.111520 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.111505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 09 23:48:20.111581 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.111556 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sdg92\"" Sep 09 23:48:20.131340 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.131321 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4grdz"] Sep 09 23:48:20.131438 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.131419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.133655 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.133634 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:48:20.133749 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.133700 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:48:20.133831 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.133746 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:48:20.134094 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.134076 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2qmv7\"" Sep 09 23:48:20.148029 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148011 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tk28q"] Sep 09 23:48:20.148114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6jffs"] Sep 09 23:48:20.148114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148066 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk"] Sep 09 23:48:20.148114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148086 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt"] Sep 09 23:48:20.148114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6f4s2"] Sep 09 23:48:20.148307 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148123 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.148357 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148127 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4grdz"] Sep 09 23:48:20.148404 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.148380 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t"] Sep 09 23:48:20.150232 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.150214 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:48:20.150324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.150284 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ccffp\"" Sep 09 23:48:20.150324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.150296 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:48:20.172038 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.171981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc5412-53b7-40f4-85f5-1962bd18251b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.172038 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjwj\" (UniqueName: \"kubernetes.io/projected/bcfc5412-53b7-40f4-85f5-1962bd18251b-kube-api-access-nkjwj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa1643-0679-4cc6-8c38-35aaddbcd401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68a34b33-1fd3-4039-8476-dda226d26bae-config\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68a34b33-1fd3-4039-8476-dda226d26bae-serving-cert\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc5412-53b7-40f4-85f5-1962bd18251b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvdm\" (UniqueName: \"kubernetes.io/projected/68a34b33-1fd3-4039-8476-dda226d26bae-kube-api-access-mfvdm\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlh7g\" (UniqueName: \"kubernetes.io/projected/f77d3ef0-05eb-447c-b7f7-1ef48fb03140-kube-api-access-hlh7g\") pod \"network-check-source-685456655f-6jffs\" (UID: \"f77d3ef0-05eb-447c-b7f7-1ef48fb03140\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkb7\" (UniqueName: \"kubernetes.io/projected/48aa1643-0679-4cc6-8c38-35aaddbcd401-kube-api-access-6vkb7\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172634 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npm4f\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.172863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.172673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/169ec6e8-392c-4150-8bd7-1af8527f0f8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.173321 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.173245 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bcfc5412-53b7-40f4-85f5-1962bd18251b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.173321 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.173288 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.173400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.173328 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:20.173400 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.173344 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:20.173484 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.173413 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.673393775 +0000 UTC m=+35.414555188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:20.174069 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.174047 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.176812 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.176779 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcfc5412-53b7-40f4-85f5-1962bd18251b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.177061 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.177039 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.177133 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.177098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.183416 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.183347 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.183542 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.183410 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjwj\" (UniqueName: \"kubernetes.io/projected/bcfc5412-53b7-40f4-85f5-1962bd18251b-kube-api-access-nkjwj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-5xdrk\" (UID: \"bcfc5412-53b7-40f4-85f5-1962bd18251b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.183542 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.183432 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npm4f\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.273331 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.273305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" Sep 09 23:48:20.274536 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfmbv\" (UniqueName: \"kubernetes.io/projected/4640a003-eace-4e71-91fa-dcd686e0e43f-kube-api-access-kfmbv\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.274608 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.274608 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa1643-0679-4cc6-8c38-35aaddbcd401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.274608 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274599 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgnq\" (UniqueName: \"kubernetes.io/projected/c2813e98-9ed9-4675-8e38-44d5c0c93052-kube-api-access-gjgnq\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.274730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf79da0b-1637-45d8-a148-b8eb5fe04409-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.274730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.274730 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.274670 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:20.274730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2813e98-9ed9-4675-8e38-44d5c0c93052-tmp\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.274730 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.274731 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.774718377 +0000 UTC m=+35.515879798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:20.275037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.275037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vxq\" (UniqueName: \"kubernetes.io/projected/bf79da0b-1637-45d8-a148-b8eb5fe04409-kube-api-access-l8vxq\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.275037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-cert\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.275037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.274989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvdm\" (UniqueName: \"kubernetes.io/projected/68a34b33-1fd3-4039-8476-dda226d26bae-kube-api-access-mfvdm\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.275037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275025 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mllw\" (UniqueName: \"kubernetes.io/projected/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-kube-api-access-2mllw\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlh7g\" (UniqueName: \"kubernetes.io/projected/f77d3ef0-05eb-447c-b7f7-1ef48fb03140-kube-api-access-hlh7g\") pod \"network-check-source-685456655f-6jffs\" (UID: \"f77d3ef0-05eb-447c-b7f7-1ef48fb03140\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkb7\" (UniqueName: \"kubernetes.io/projected/48aa1643-0679-4cc6-8c38-35aaddbcd401-kube-api-access-6vkb7\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/169ec6e8-392c-4150-8bd7-1af8527f0f8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4640a003-eace-4e71-91fa-dcd686e0e43f-tmp-dir\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4640a003-eace-4e71-91fa-dcd686e0e43f-config-volume\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68a34b33-1fd3-4039-8476-dda226d26bae-serving-cert\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.275270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa1643-0679-4cc6-8c38-35aaddbcd401-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.275760 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.275760 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68a34b33-1fd3-4039-8476-dda226d26bae-config\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.275760 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.275380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2813e98-9ed9-4675-8e38-44d5c0c93052-klusterlet-config\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.276078 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.276055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68a34b33-1fd3-4039-8476-dda226d26bae-config\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.276193 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.276171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/169ec6e8-392c-4150-8bd7-1af8527f0f8e-nginx-conf\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.277409 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.277379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.277570 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.277548 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-ca\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.277644 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.277584 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68a34b33-1fd3-4039-8476-dda226d26bae-serving-cert\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.277644 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.277605 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.277909 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.277891 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48aa1643-0679-4cc6-8c38-35aaddbcd401-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.282464 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.282438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvdm\" (UniqueName: \"kubernetes.io/projected/68a34b33-1fd3-4039-8476-dda226d26bae-kube-api-access-mfvdm\") pod \"service-ca-operator-859f94c4b-zz8l5\" (UID: \"68a34b33-1fd3-4039-8476-dda226d26bae\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.283549 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.283528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlh7g\" (UniqueName: \"kubernetes.io/projected/f77d3ef0-05eb-447c-b7f7-1ef48fb03140-kube-api-access-hlh7g\") pod \"network-check-source-685456655f-6jffs\" (UID: \"f77d3ef0-05eb-447c-b7f7-1ef48fb03140\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" Sep 09 23:48:20.283773 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.283751 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkb7\" (UniqueName: \"kubernetes.io/projected/48aa1643-0679-4cc6-8c38-35aaddbcd401-kube-api-access-6vkb7\") pod \"cluster-proxy-proxy-agent-5c5fcb955f-brgjt\" (UID: \"48aa1643-0679-4cc6-8c38-35aaddbcd401\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.306909 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.306886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" Sep 09 23:48:20.361971 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.361467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:48:20.370262 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.370229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" Sep 09 23:48:20.376541 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2813e98-9ed9-4675-8e38-44d5c0c93052-klusterlet-config\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.376655 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfmbv\" (UniqueName: \"kubernetes.io/projected/4640a003-eace-4e71-91fa-dcd686e0e43f-kube-api-access-kfmbv\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.376655 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgnq\" (UniqueName: \"kubernetes.io/projected/c2813e98-9ed9-4675-8e38-44d5c0c93052-kube-api-access-gjgnq\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.376787 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf79da0b-1637-45d8-a148-b8eb5fe04409-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.376787 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2813e98-9ed9-4675-8e38-44d5c0c93052-tmp\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.376787 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vxq\" (UniqueName: \"kubernetes.io/projected/bf79da0b-1637-45d8-a148-b8eb5fe04409-kube-api-access-l8vxq\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.376787 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-cert\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.377005 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mllw\" (UniqueName: \"kubernetes.io/projected/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-kube-api-access-2mllw\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.377005 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.377005 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376888 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4640a003-eace-4e71-91fa-dcd686e0e43f-tmp-dir\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.377005 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.376914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4640a003-eace-4e71-91fa-dcd686e0e43f-config-volume\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.380555 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.377630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4640a003-eace-4e71-91fa-dcd686e0e43f-config-volume\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.380555 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.379432 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2813e98-9ed9-4675-8e38-44d5c0c93052-tmp\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.380555 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.380022 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:20.380555 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.380074 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.880057074 +0000 UTC m=+35.621218502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:20.380555 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.380346 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4640a003-eace-4e71-91fa-dcd686e0e43f-tmp-dir\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.383030 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.382984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf79da0b-1637-45d8-a148-b8eb5fe04409-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.383216 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.383190 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c2813e98-9ed9-4675-8e38-44d5c0c93052-klusterlet-config\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.384949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.384909 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-cert\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.388579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.388552 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgnq\" (UniqueName: \"kubernetes.io/projected/c2813e98-9ed9-4675-8e38-44d5c0c93052-kube-api-access-gjgnq\") pod \"klusterlet-addon-workmgr-89b6f68b-srqwk\" (UID: \"c2813e98-9ed9-4675-8e38-44d5c0c93052\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.389994 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.389951 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfmbv\" (UniqueName: \"kubernetes.io/projected/4640a003-eace-4e71-91fa-dcd686e0e43f-kube-api-access-kfmbv\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.391001 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.390976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vxq\" (UniqueName: \"kubernetes.io/projected/bf79da0b-1637-45d8-a148-b8eb5fe04409-kube-api-access-l8vxq\") pod \"managed-serviceaccount-addon-agent-686476f844-cx26t\" (UID: \"bf79da0b-1637-45d8-a148-b8eb5fe04409\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.391548 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.391509 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mllw\" (UniqueName: \"kubernetes.io/projected/9e3f4a25-b01d-4cbf-a585-f4369c79d73f-kube-api-access-2mllw\") pod \"ingress-canary-6f4s2\" (UID: \"9e3f4a25-b01d-4cbf-a585-f4369c79d73f\") " pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.394944 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.394529 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:20.421307 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.421073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" Sep 09 23:48:20.449379 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.446161 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6f4s2" Sep 09 23:48:20.580991 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.580958 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk"] Sep 09 23:48:20.584754 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.584719 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfc5412_53b7_40f4_85f5_1962bd18251b.slice/crio-cffce12aa72a0c874976222b4155f31a3a71b9137130b24286ee52bcc9da82f1 WatchSource:0}: Error finding container cffce12aa72a0c874976222b4155f31a3a71b9137130b24286ee52bcc9da82f1: Status 404 returned error can't find the container with id cffce12aa72a0c874976222b4155f31a3a71b9137130b24286ee52bcc9da82f1 Sep 09 23:48:20.614678 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.614655 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5"] Sep 09 23:48:20.617085 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.617061 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a34b33_1fd3_4039_8476_dda226d26bae.slice/crio-6a8aa526186d4ccd004f8d8e4f09f36477d4f93b5d2f462ffd3f5a0dd82faad5 WatchSource:0}: Error finding container 6a8aa526186d4ccd004f8d8e4f09f36477d4f93b5d2f462ffd3f5a0dd82faad5: Status 404 returned error can't find the container with id 6a8aa526186d4ccd004f8d8e4f09f36477d4f93b5d2f462ffd3f5a0dd82faad5 Sep 09 23:48:20.658200 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.658176 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt"] Sep 09 23:48:20.661213 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.660871 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48aa1643_0679_4cc6_8c38_35aaddbcd401.slice/crio-8f807910f225a7a370a9d67451f529d174c630b110ac21a7ec67e90531b90689 WatchSource:0}: Error finding container 8f807910f225a7a370a9d67451f529d174c630b110ac21a7ec67e90531b90689: Status 404 returned error can't find the container with id 8f807910f225a7a370a9d67451f529d174c630b110ac21a7ec67e90531b90689 Sep 09 23:48:20.673402 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.673381 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6jffs"] Sep 09 23:48:20.676057 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.676028 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77d3ef0_05eb_447c_b7f7_1ef48fb03140.slice/crio-ecc6bd6900f848bfd86de3ddab5e92d6e544d7aeb641de60d86399407a06274d WatchSource:0}: Error finding container ecc6bd6900f848bfd86de3ddab5e92d6e544d7aeb641de60d86399407a06274d: Status 404 returned error can't find the container with id ecc6bd6900f848bfd86de3ddab5e92d6e544d7aeb641de60d86399407a06274d Sep 09 23:48:20.680848 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.680822 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:20.681025 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.681002 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:20.681025 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.681026 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:20.681171 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.681079 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:21.681061866 +0000 UTC m=+36.422223295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:20.697774 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.697719 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk"] Sep 09 23:48:20.700075 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.700056 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2813e98_9ed9_4675_8e38_44d5c0c93052.slice/crio-2510f11f85d5dabb8bbdb682b9bd1bbbaf951ce03298e670cd3190c23cdf58d1 WatchSource:0}: Error finding container 2510f11f85d5dabb8bbdb682b9bd1bbbaf951ce03298e670cd3190c23cdf58d1: Status 404 returned error can't find the container with id 2510f11f85d5dabb8bbdb682b9bd1bbbaf951ce03298e670cd3190c23cdf58d1 Sep 09 23:48:20.726225 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.726194 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t"] Sep 09 23:48:20.728369 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.728348 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf79da0b_1637_45d8_a148_b8eb5fe04409.slice/crio-eb1beb3fc81fe57fefd93bfd65b91979ee78a11da40d98cd18f8a1744cf50ce6 WatchSource:0}: Error finding container eb1beb3fc81fe57fefd93bfd65b91979ee78a11da40d98cd18f8a1744cf50ce6: Status 404 returned error can't find the container with id eb1beb3fc81fe57fefd93bfd65b91979ee78a11da40d98cd18f8a1744cf50ce6 Sep 09 23:48:20.739361 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.739338 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6f4s2"] Sep 09 23:48:20.742053 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:20.742032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3f4a25_b01d_4cbf_a585_f4369c79d73f.slice/crio-8b59194d3ba131b489977c56e8a35e715f2ea1828249e4b525aa6573d317e13d WatchSource:0}: Error finding container 8b59194d3ba131b489977c56e8a35e715f2ea1828249e4b525aa6573d317e13d: Status 404 returned error can't find the container with id 8b59194d3ba131b489977c56e8a35e715f2ea1828249e4b525aa6573d317e13d Sep 09 23:48:20.772437 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.772415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:20.772545 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.772451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:20.772545 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.772451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:20.775006 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.774987 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:48:20.775109 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.775035 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:48:20.775109 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.775073 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7tkk\"" Sep 09 23:48:20.775236 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.774995 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7wg5\"" Sep 09 23:48:20.781776 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.781758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:20.781938 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.781918 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:20.782011 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.781995 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:21.781976076 +0000 UTC m=+36.523137488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:20.834925 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.834883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:20.882621 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.882586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:20.882782 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.882693 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:20.882782 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:20.882756 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:21.882738237 +0000 UTC m=+36.623899670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:20.915829 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:20.915778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:21.017178 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.017104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:21.091554 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.091508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" event={"ID":"bf79da0b-1637-45d8-a148-b8eb5fe04409","Type":"ContainerStarted","Data":"eb1beb3fc81fe57fefd93bfd65b91979ee78a11da40d98cd18f8a1744cf50ce6"} Sep 09 23:48:21.092812 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.092772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" event={"ID":"c2813e98-9ed9-4675-8e38-44d5c0c93052","Type":"ContainerStarted","Data":"2510f11f85d5dabb8bbdb682b9bd1bbbaf951ce03298e670cd3190c23cdf58d1"} Sep 09 23:48:21.094035 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.094003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerStarted","Data":"8f807910f225a7a370a9d67451f529d174c630b110ac21a7ec67e90531b90689"} Sep 09 23:48:21.095231 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.095202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" event={"ID":"f77d3ef0-05eb-447c-b7f7-1ef48fb03140","Type":"ContainerStarted","Data":"ecc6bd6900f848bfd86de3ddab5e92d6e544d7aeb641de60d86399407a06274d"} Sep 09 23:48:21.096529 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.096494 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" event={"ID":"bcfc5412-53b7-40f4-85f5-1962bd18251b","Type":"ContainerStarted","Data":"cffce12aa72a0c874976222b4155f31a3a71b9137130b24286ee52bcc9da82f1"} Sep 09 23:48:21.097743 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.097714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6f4s2" event={"ID":"9e3f4a25-b01d-4cbf-a585-f4369c79d73f","Type":"ContainerStarted","Data":"8b59194d3ba131b489977c56e8a35e715f2ea1828249e4b525aa6573d317e13d"} Sep 09 23:48:21.098995 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.098977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" event={"ID":"68a34b33-1fd3-4039-8476-dda226d26bae","Type":"ContainerStarted","Data":"6a8aa526186d4ccd004f8d8e4f09f36477d4f93b5d2f462ffd3f5a0dd82faad5"} Sep 09 23:48:21.690952 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.690345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:21.690952 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.690521 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:21.690952 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.690538 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:21.690952 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.690594 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:23.69057405 +0000 UTC m=+38.431735486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:21.791603 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.791004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:21.791603 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.791213 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:21.791603 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.791271 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:23.791252783 +0000 UTC m=+38.532414215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:21.892879 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:21.892203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:21.892879 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.892452 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:21.892879 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:21.892523 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:23.892494652 +0000 UTC m=+38.633656085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:23.714877 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:23.713655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:23.714877 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.714032 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:23.714877 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.714099 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:23.714877 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.714208 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:27.714142327 +0000 UTC m=+42.455303762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:23.815573 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:23.814963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:23.815573 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.815154 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:23.815573 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.815215 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:27.815196501 +0000 UTC m=+42.556357916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:23.916340 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:23.916254 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:23.916554 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.916536 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:23.916634 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:23.916604 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:27.916585268 +0000 UTC m=+42.657746695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:25.140648 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:25.140563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:27.750713 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:27.750679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:27.751121 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.750847 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:27.751121 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.750873 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:27.751121 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.750938 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:35.750921024 +0000 UTC m=+50.492082663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:27.851901 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:27.851865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:27.852067 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.852040 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:27.852133 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.852121 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:35.852097229 +0000 UTC m=+50.593258654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:27.952506 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:27.952472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:27.952695 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.952643 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:27.952755 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:27.952719 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:35.952697735 +0000 UTC m=+50.693859181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:30.614190 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:30.614153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:30.715052 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:30.715016 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:30.769268 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:30.769242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:30.819212 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:30.819180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:34.544819 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:34.541652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:35.154786 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.154690 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6f4s2" event={"ID":"9e3f4a25-b01d-4cbf-a585-f4369c79d73f","Type":"ContainerStarted","Data":"cf8c4b855ab1a61adf794def950ed80e4c181e98927d2f87997408a0adf89970"} Sep 09 23:48:35.156252 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.156223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" event={"ID":"68a34b33-1fd3-4039-8476-dda226d26bae","Type":"ContainerStarted","Data":"2c04e411ba439775cfda49da50123653abb01c7d34cad714f583e0ed5ee1294e"} Sep 09 23:48:35.159365 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.159337 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="bdc8a34fa06df15c0a02b36a31fc215c073c6b7ea385f58dc9b53bd39a57f1cc" exitCode=0 Sep 09 23:48:35.159475 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.159421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"bdc8a34fa06df15c0a02b36a31fc215c073c6b7ea385f58dc9b53bd39a57f1cc"} Sep 09 23:48:35.161184 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.161158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" event={"ID":"bf79da0b-1637-45d8-a148-b8eb5fe04409","Type":"ContainerStarted","Data":"06fd5f43c1e923342466058471f893c0ec08865e1c6031ed55009c30d2002ed8"} Sep 09 23:48:35.162827 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.162762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" event={"ID":"c2813e98-9ed9-4675-8e38-44d5c0c93052","Type":"ContainerStarted","Data":"ce19aa23379d6cc535c77ea13513750bf9f6898c67d487b78b83c00f2b9b8f8a"} Sep 09 23:48:35.163035 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.163018 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:35.164974 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.164911 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" Sep 09 23:48:35.165897 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.165869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerStarted","Data":"0c1af9f80d317606966d9de255ec9ae1776ca6a5e74582dab0d1f3d42eae38b1"} Sep 09 23:48:35.165991 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.165908 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerStarted","Data":"936b7f6f4ead72d9bc24a5eb704486bbffcbf900817dd872d749f8a35954df23"} Sep 09 23:48:35.165991 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.165926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerStarted","Data":"a9ec153fdf161b842a73456d6fc7ea373516aa90507320fb4cebee35ac58c2c4"} Sep 09 23:48:35.167768 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.167523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" event={"ID":"f77d3ef0-05eb-447c-b7f7-1ef48fb03140","Type":"ContainerStarted","Data":"76db9144a0086d9ce237904527a9d828fc6e5d6f69fcb5375578637c32752811"} Sep 09 23:48:35.168681 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.168633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6f4s2" podStartSLOduration=2.61605098 podStartE2EDuration="16.168615987s" totalImagesPullingTime="13.552565007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.168273758 +0000 UTC m=+49.909435192" watchObservedRunningTime="2026-09-09 23:48:35.168615987 +0000 UTC m=+49.909777421" Sep 09 23:48:35.169556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.169533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" event={"ID":"bcfc5412-53b7-40f4-85f5-1962bd18251b","Type":"ContainerStarted","Data":"5747e35e3c207624b4aa7b43f619bd32a8ec4474e4a281e4a7d244457256de11"} Sep 09 23:48:35.201844 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.200090 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" podStartSLOduration=16.544166108 podStartE2EDuration="30.200072203s" totalImagesPullingTime="13.655906095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.185127834 +0000 UTC m=+49.926289270" watchObservedRunningTime="2026-09-09 23:48:35.200072203 +0000 UTC m=+49.941233639" Sep 09 23:48:35.223635 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.222080 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-686476f844-cx26t" podStartSLOduration=16.658263999 podStartE2EDuration="30.222061953s" totalImagesPullingTime="13.563797954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.200908739 +0000 UTC m=+49.942070173" watchObservedRunningTime="2026-09-09 23:48:35.222061953 +0000 UTC m=+49.963223389" Sep 09 23:48:35.247553 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.247374 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" podStartSLOduration=30.570287862 podStartE2EDuration="44.247356222s" totalImagesPullingTime="13.67706836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.234124725 +0000 UTC m=+49.975286160" watchObservedRunningTime="2026-09-09 23:48:35.247356222 +0000 UTC m=+49.988517651" Sep 09 23:48:35.248043 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.247771 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-89b6f68b-srqwk" podStartSLOduration=16.630270011 podStartE2EDuration="30.247763532s" totalImagesPullingTime="13.617493521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.246975628 +0000 UTC m=+49.988137064" watchObservedRunningTime="2026-09-09 23:48:35.247763532 +0000 UTC m=+49.988924961" Sep 09 23:48:35.261577 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.261532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-6jffs" podStartSLOduration=32.642015176 podStartE2EDuration="46.261511983s" totalImagesPullingTime="13.619496807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.260448421 +0000 UTC m=+50.001609866" watchObservedRunningTime="2026-09-09 23:48:35.261511983 +0000 UTC m=+50.002673418" Sep 09 23:48:35.511997 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.511868 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" podStartSLOduration=33.839154212 podStartE2EDuration="47.511840491s" totalImagesPullingTime="13.672686279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.277690333 +0000 UTC m=+50.018851771" watchObservedRunningTime="2026-09-09 23:48:35.511840491 +0000 UTC m=+50.253001927" Sep 09 23:48:35.512253 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.512234 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996"] Sep 09 23:48:35.514593 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.514575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" Sep 09 23:48:35.516837 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.516736 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nr4p4\"" Sep 09 23:48:35.516965 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.516859 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:35.516965 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.516925 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 23:48:35.518331 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.518308 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:35.524967 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.524942 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996"] Sep 09 23:48:35.578219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.578190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:35.619700 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.619674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npx9q\" (UniqueName: \"kubernetes.io/projected/ee723837-4f4c-45ad-bcc2-8efc41c72197-kube-api-access-npx9q\") pod \"migrator-fdbb8fdff-sk996\" (UID: \"ee723837-4f4c-45ad-bcc2-8efc41c72197\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" Sep 09 23:48:35.637824 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.637782 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:35.720855 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.720827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npx9q\" (UniqueName: \"kubernetes.io/projected/ee723837-4f4c-45ad-bcc2-8efc41c72197-kube-api-access-npx9q\") pod \"migrator-fdbb8fdff-sk996\" (UID: \"ee723837-4f4c-45ad-bcc2-8efc41c72197\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" Sep 09 23:48:35.729136 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.729114 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npx9q\" (UniqueName: \"kubernetes.io/projected/ee723837-4f4c-45ad-bcc2-8efc41c72197-kube-api-access-npx9q\") pod \"migrator-fdbb8fdff-sk996\" (UID: \"ee723837-4f4c-45ad-bcc2-8efc41c72197\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" Sep 09 23:48:35.822075 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.822014 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:35.822171 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:35.822152 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:48:35.822171 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:35.822166 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7665d5674d-nf9dg: secret "image-registry-tls" not found Sep 09 23:48:35.822235 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:35.822216 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls podName:45d1cda4-d228-4b5c-8a1b-f726a2ecb636 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:51.822199877 +0000 UTC m=+66.563361307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls") pod "image-registry-7665d5674d-nf9dg" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636") : secret "image-registry-tls" not found Sep 09 23:48:35.824996 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.824977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" Sep 09 23:48:35.922443 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:35.922412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:35.922604 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:35.922560 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 23:48:35.922651 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:35.922622 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert podName:169ec6e8-392c-4150-8bd7-1af8527f0f8e nodeName:}" failed. No retries permitted until 2026-09-09 23:48:51.922606446 +0000 UTC m=+66.663767858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tk28q" (UID: "169ec6e8-392c-4150-8bd7-1af8527f0f8e") : secret "networking-console-plugin-cert" not found Sep 09 23:48:36.023278 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:36.023237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:36.023445 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:36.023382 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:48:36.023502 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:48:36.023448 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls podName:4640a003-eace-4e71-91fa-dcd686e0e43f nodeName:}" failed. No retries permitted until 2026-09-09 23:48:52.023432507 +0000 UTC m=+66.764593918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls") pod "dns-default-4grdz" (UID: "4640a003-eace-4e71-91fa-dcd686e0e43f") : secret "dns-default-metrics-tls" not found Sep 09 23:48:36.098652 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:36.098611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996"] Sep 09 23:48:36.101245 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:36.101216 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee723837_4f4c_45ad_bcc2_8efc41c72197.slice/crio-b7dd679caf41408ff9403e10e4545297d99a090c3cbfc4ad259a2d94e30a8a6e WatchSource:0}: Error finding container b7dd679caf41408ff9403e10e4545297d99a090c3cbfc4ad259a2d94e30a8a6e: Status 404 returned error can't find the container with id b7dd679caf41408ff9403e10e4545297d99a090c3cbfc4ad259a2d94e30a8a6e Sep 09 23:48:36.173645 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:36.173615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" event={"ID":"ee723837-4f4c-45ad-bcc2-8efc41c72197","Type":"ContainerStarted","Data":"b7dd679caf41408ff9403e10e4545297d99a090c3cbfc4ad259a2d94e30a8a6e"} Sep 09 23:48:36.176473 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:36.176452 2572 generic.go:356] "Generic (PLEG): container finished" podID="c73eea75-8d69-4bf2-a263-d4488cd4b24d" containerID="d8f3bee223fc77cd5d24e61860bca49f6c7acb6b643f349bfa0cbae9b581f5ac" exitCode=0 Sep 09 23:48:36.176590 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:36.176568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerDied","Data":"d8f3bee223fc77cd5d24e61860bca49f6c7acb6b643f349bfa0cbae9b581f5ac"} Sep 09 23:48:37.184488 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:37.184447 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4j49" event={"ID":"c73eea75-8d69-4bf2-a263-d4488cd4b24d","Type":"ContainerStarted","Data":"43707ec88c7d962d57ad397f302caff19e68b5227d3427743aca977e46033ab1"} Sep 09 23:48:37.204391 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:37.204345 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w4j49" podStartSLOduration=7.9027287059999995 podStartE2EDuration="51.20432757s" totalImagesPullingTime="43.301598864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:37.203042367 +0000 UTC m=+51.944203793" watchObservedRunningTime="2026-09-09 23:48:37.20432757 +0000 UTC m=+51.945489005" Sep 09 23:48:38.189913 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.189877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" event={"ID":"ee723837-4f4c-45ad-bcc2-8efc41c72197","Type":"ContainerStarted","Data":"c280821838f720c33a4707b71e6f23381cf6ce66c4fb0515e83438d79941c90e"} Sep 09 23:48:38.190264 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.189930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" event={"ID":"ee723837-4f4c-45ad-bcc2-8efc41c72197","Type":"ContainerStarted","Data":"67422e67e1079aaa277187bcdfee2f559ec34e4bb196413fa7c110b17b031d01"} Sep 09 23:48:38.205453 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.205410 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-sk996" podStartSLOduration=2.036835508 podStartE2EDuration="3.205395183s" totalImagesPullingTime="1.168559675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:38.204792708 +0000 UTC m=+52.945954155" watchObservedRunningTime="2026-09-09 23:48:38.205395183 +0000 UTC m=+52.946556650" Sep 09 23:48:38.308492 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.308464 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-s265n"] Sep 09 23:48:38.310333 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.310318 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.312233 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.312198 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 09 23:48:38.312393 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.312241 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 09 23:48:38.312393 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.312257 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 09 23:48:38.312393 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.312352 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r9xkk\"" Sep 09 23:48:38.312613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.312581 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 09 23:48:38.318539 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.318518 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-s265n"] Sep 09 23:48:38.442884 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.442829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-key\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.442884 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.442870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-cabundle\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.443010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.442949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qp6r\" (UniqueName: \"kubernetes.io/projected/19819a07-6d07-4e99-9b89-a6e57c0f75de-kube-api-access-5qp6r\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.544080 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.544047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-key\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.544205 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.544102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-cabundle\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.544205 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.544181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qp6r\" (UniqueName: \"kubernetes.io/projected/19819a07-6d07-4e99-9b89-a6e57c0f75de-kube-api-access-5qp6r\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.544823 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.544780 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-cabundle\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.546409 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.546368 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19819a07-6d07-4e99-9b89-a6e57c0f75de-signing-key\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.551699 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.551674 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qp6r\" (UniqueName: \"kubernetes.io/projected/19819a07-6d07-4e99-9b89-a6e57c0f75de-kube-api-access-5qp6r\") pod \"service-ca-75d99c484-s265n\" (UID: \"19819a07-6d07-4e99-9b89-a6e57c0f75de\") " pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.619933 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.619909 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-s265n" Sep 09 23:48:38.887465 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:38.887437 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-s265n"] Sep 09 23:48:38.889827 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:38.889783 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19819a07_6d07_4e99_9b89_a6e57c0f75de.slice/crio-9b4a939cb6d775b241af8066bac08511b37ef4a50f908cee379973f865ba4688 WatchSource:0}: Error finding container 9b4a939cb6d775b241af8066bac08511b37ef4a50f908cee379973f865ba4688: Status 404 returned error can't find the container with id 9b4a939cb6d775b241af8066bac08511b37ef4a50f908cee379973f865ba4688 Sep 09 23:48:39.198917 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:39.198829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-s265n" event={"ID":"19819a07-6d07-4e99-9b89-a6e57c0f75de","Type":"ContainerStarted","Data":"78fe10a134d5b9287907103277ef5ed3adbbdab45b5c2f40fa76b8986866f5d1"} Sep 09 23:48:39.198917 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:39.198900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-s265n" event={"ID":"19819a07-6d07-4e99-9b89-a6e57c0f75de","Type":"ContainerStarted","Data":"9b4a939cb6d775b241af8066bac08511b37ef4a50f908cee379973f865ba4688"} Sep 09 23:48:39.216207 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:39.216163 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-s265n" podStartSLOduration=1.216150544 podStartE2EDuration="1.216150544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:39.216035223 +0000 UTC m=+53.957196657" watchObservedRunningTime="2026-09-09 23:48:39.216150544 +0000 UTC m=+53.957311981" Sep 09 23:48:45.083349 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:45.083323 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-std7w" Sep 09 23:48:50.635747 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.635659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:50.635747 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.635711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:50.637829 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.637793 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:48:50.637909 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.637886 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:48:50.648642 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.648607 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5d618c-7cb8-4d74-8fe9-c1611be41dcd-metrics-certs\") pod \"network-metrics-daemon-8j4qg\" (UID: \"db5d618c-7cb8-4d74-8fe9-c1611be41dcd\") " pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:50.648764 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.648751 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/572a8f87-4f72-4cd1-917d-53e18972aa49-original-pull-secret\") pod \"global-pull-secret-syncer-v2dpx\" (UID: \"572a8f87-4f72-4cd1-917d-53e18972aa49\") " pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:50.736091 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.736064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:50.738167 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.738147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfcm\" (UniqueName: \"kubernetes.io/projected/a8f14dc2-9352-4960-9249-c469f4671af8-kube-api-access-7tfcm\") pod \"network-check-target-j4jx9\" (UID: \"a8f14dc2-9352-4960-9249-c469f4671af8\") " pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:50.787701 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.787676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7tkk\"" Sep 09 23:48:50.795377 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.795357 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7wg5\"" Sep 09 23:48:50.795481 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.795466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8j4qg" Sep 09 23:48:50.799213 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.799198 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2dpx" Sep 09 23:48:50.804075 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:50.804055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:51.071478 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.071447 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8j4qg"] Sep 09 23:48:51.074619 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:51.074595 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5d618c_7cb8_4d74_8fe9_c1611be41dcd.slice/crio-1070aad51ceb1b33baf93298fa4f5fbca2d16a2dbe0457254fd572f8d865dca9 WatchSource:0}: Error finding container 1070aad51ceb1b33baf93298fa4f5fbca2d16a2dbe0457254fd572f8d865dca9: Status 404 returned error can't find the container with id 1070aad51ceb1b33baf93298fa4f5fbca2d16a2dbe0457254fd572f8d865dca9 Sep 09 23:48:51.084741 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:51.084713 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f14dc2_9352_4960_9249_c469f4671af8.slice/crio-b900a51313b4b869bd3967cbfbb32c60f1f2554a7165865b0377e857ce8fd39f WatchSource:0}: Error finding container b900a51313b4b869bd3967cbfbb32c60f1f2554a7165865b0377e857ce8fd39f: Status 404 returned error can't find the container with id b900a51313b4b869bd3967cbfbb32c60f1f2554a7165865b0377e857ce8fd39f Sep 09 23:48:51.086070 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.086054 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j4jx9"] Sep 09 23:48:51.086412 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:51.086386 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572a8f87_4f72_4cd1_917d_53e18972aa49.slice/crio-0de57d3f8d6c1c2eeace04a5b8450b4c76700971d0e5d679ea3cfe9f7bb03f39 WatchSource:0}: Error finding container 0de57d3f8d6c1c2eeace04a5b8450b4c76700971d0e5d679ea3cfe9f7bb03f39: Status 404 returned error can't find the container with id 0de57d3f8d6c1c2eeace04a5b8450b4c76700971d0e5d679ea3cfe9f7bb03f39 Sep 09 23:48:51.087095 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.087056 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2dpx"] Sep 09 23:48:51.238135 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.238066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2dpx" event={"ID":"572a8f87-4f72-4cd1-917d-53e18972aa49","Type":"ContainerStarted","Data":"0de57d3f8d6c1c2eeace04a5b8450b4c76700971d0e5d679ea3cfe9f7bb03f39"} Sep 09 23:48:51.239556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.239526 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j4jx9" event={"ID":"a8f14dc2-9352-4960-9249-c469f4671af8","Type":"ContainerStarted","Data":"dd2319547faf0e0b0c5ce9cf3500854190481442b73881a1270d2aa2ee4a047c"} Sep 09 23:48:51.239651 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.239560 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j4jx9" event={"ID":"a8f14dc2-9352-4960-9249-c469f4671af8","Type":"ContainerStarted","Data":"b900a51313b4b869bd3967cbfbb32c60f1f2554a7165865b0377e857ce8fd39f"} Sep 09 23:48:51.239699 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.239660 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:48:51.240790 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.240771 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8j4qg" event={"ID":"db5d618c-7cb8-4d74-8fe9-c1611be41dcd","Type":"ContainerStarted","Data":"1070aad51ceb1b33baf93298fa4f5fbca2d16a2dbe0457254fd572f8d865dca9"} Sep 09 23:48:51.253583 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.253545 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j4jx9" podStartSLOduration=65.253533469 podStartE2EDuration="1m5.253533469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:51.253311906 +0000 UTC m=+65.994473340" watchObservedRunningTime="2026-09-09 23:48:51.253533469 +0000 UTC m=+65.994694942" Sep 09 23:48:51.844991 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.844959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:51.847437 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.847413 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"image-registry-7665d5674d-nf9dg\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:51.946156 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.946124 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:51.948494 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:51.948473 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/169ec6e8-392c-4150-8bd7-1af8527f0f8e-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tk28q\" (UID: \"169ec6e8-392c-4150-8bd7-1af8527f0f8e\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:52.046687 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.046649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:52.049534 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.049511 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4640a003-eace-4e71-91fa-dcd686e0e43f-metrics-tls\") pod \"dns-default-4grdz\" (UID: \"4640a003-eace-4e71-91fa-dcd686e0e43f\") " pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:52.097888 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.097829 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kmlm6\"" Sep 09 23:48:52.106694 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.106672 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:52.131280 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.131261 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9hlgd\"" Sep 09 23:48:52.140139 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.140117 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" Sep 09 23:48:52.259561 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.259352 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ccffp\"" Sep 09 23:48:52.268225 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.268160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:52.398556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.398525 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:48:52.435571 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.435325 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tk28q"] Sep 09 23:48:52.548166 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:52.548135 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4grdz"] Sep 09 23:48:52.581593 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:52.581565 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640a003_eace_4e71_91fa_dcd686e0e43f.slice/crio-a5e1839319bdcbb0793513dac6ddbe66458524576cdb24da6ff1b76d38d18b27 WatchSource:0}: Error finding container a5e1839319bdcbb0793513dac6ddbe66458524576cdb24da6ff1b76d38d18b27: Status 404 returned error can't find the container with id a5e1839319bdcbb0793513dac6ddbe66458524576cdb24da6ff1b76d38d18b27 Sep 09 23:48:52.582245 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:52.582216 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169ec6e8_392c_4150_8bd7_1af8527f0f8e.slice/crio-bfdf6f04f2126da81f24c7cc7a3e940e8826deef7f31452968fc9cca7f4970f4 WatchSource:0}: Error finding container bfdf6f04f2126da81f24c7cc7a3e940e8826deef7f31452968fc9cca7f4970f4: Status 404 returned error can't find the container with id bfdf6f04f2126da81f24c7cc7a3e940e8826deef7f31452968fc9cca7f4970f4 Sep 09 23:48:52.583279 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:52.583031 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d1cda4_d228_4b5c_8a1b_f726a2ecb636.slice/crio-e80a48a3e45dd3085cebce5e32bf18d1b9ea98965412c01aa5b12623868d4789 WatchSource:0}: Error finding container e80a48a3e45dd3085cebce5e32bf18d1b9ea98965412c01aa5b12623868d4789: Status 404 returned error can't find the container with id e80a48a3e45dd3085cebce5e32bf18d1b9ea98965412c01aa5b12623868d4789 Sep 09 23:48:53.253041 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.253003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4grdz" event={"ID":"4640a003-eace-4e71-91fa-dcd686e0e43f","Type":"ContainerStarted","Data":"a5e1839319bdcbb0793513dac6ddbe66458524576cdb24da6ff1b76d38d18b27"} Sep 09 23:48:53.255236 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.255075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" event={"ID":"45d1cda4-d228-4b5c-8a1b-f726a2ecb636","Type":"ContainerStarted","Data":"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0"} Sep 09 23:48:53.255236 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.255129 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" event={"ID":"45d1cda4-d228-4b5c-8a1b-f726a2ecb636","Type":"ContainerStarted","Data":"e80a48a3e45dd3085cebce5e32bf18d1b9ea98965412c01aa5b12623868d4789"} Sep 09 23:48:53.255562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.255494 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:48:53.258520 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.258487 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8j4qg" event={"ID":"db5d618c-7cb8-4d74-8fe9-c1611be41dcd","Type":"ContainerStarted","Data":"5b0b48d731724e7c7a8f002a317de0f98254c07bace8dad5dc84ffdf9aa297b5"} Sep 09 23:48:53.258635 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.258537 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8j4qg" event={"ID":"db5d618c-7cb8-4d74-8fe9-c1611be41dcd","Type":"ContainerStarted","Data":"47e3a5116ea2c4d29a5dd05c4d92549ac2d7eddf6ba18fd0addbccde72edd1d1"} Sep 09 23:48:53.261039 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.260988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" event={"ID":"169ec6e8-392c-4150-8bd7-1af8527f0f8e","Type":"ContainerStarted","Data":"bfdf6f04f2126da81f24c7cc7a3e940e8826deef7f31452968fc9cca7f4970f4"} Sep 09 23:48:53.276638 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.276587 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" podStartSLOduration=66.276562583 podStartE2EDuration="1m6.276562583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:53.27421015 +0000 UTC m=+68.015371584" watchObservedRunningTime="2026-09-09 23:48:53.276562583 +0000 UTC m=+68.017724019" Sep 09 23:48:53.289465 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:53.289420 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8j4qg" podStartSLOduration=65.755436865 podStartE2EDuration="1m7.289404875s" totalImagesPullingTime="1.53396801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:53.288130414 +0000 UTC m=+68.029291839" watchObservedRunningTime="2026-09-09 23:48:53.289404875 +0000 UTC m=+68.030566310" Sep 09 23:48:56.274354 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.274315 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4grdz" event={"ID":"4640a003-eace-4e71-91fa-dcd686e0e43f","Type":"ContainerStarted","Data":"f0cb19c3c99fb49922d642dfb82322ee29e45dcfbcf050c28de3bcc462843b42"} Sep 09 23:48:56.274792 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.274402 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4grdz" event={"ID":"4640a003-eace-4e71-91fa-dcd686e0e43f","Type":"ContainerStarted","Data":"788d93211003e4ae41760be4c02add77c06bcbd1b623cb5bd69b4865ade5a587"} Sep 09 23:48:56.274792 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.274431 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4grdz" Sep 09 23:48:56.275955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.275929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2dpx" event={"ID":"572a8f87-4f72-4cd1-917d-53e18972aa49","Type":"ContainerStarted","Data":"b17688bbd8c947bbb94d887cc15467e642d9b3ce9eca4efeac384c37aa59b7b0"} Sep 09 23:48:56.277431 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.277405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" event={"ID":"169ec6e8-392c-4150-8bd7-1af8527f0f8e","Type":"ContainerStarted","Data":"0b7428b945f9315765f1ccaec017500d8e7da3b3967692434aad4804d7f2a45b"} Sep 09 23:48:56.288426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.288381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4grdz" podStartSLOduration=34.102002665 podStartE2EDuration="37.288369861s" totalImagesPullingTime="3.186367196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:56.288138573 +0000 UTC m=+71.029300020" watchObservedRunningTime="2026-09-09 23:48:56.288369861 +0000 UTC m=+71.029531297" Sep 09 23:48:56.301097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.301058 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v2dpx" podStartSLOduration=64.600461193 podStartE2EDuration="1m9.301044839s" totalImagesPullingTime="4.700583646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:56.299858273 +0000 UTC m=+71.041019707" watchObservedRunningTime="2026-09-09 23:48:56.301044839 +0000 UTC m=+71.042206273" Sep 09 23:48:56.312918 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:56.312878 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-tk28q" podStartSLOduration=37.130093937 podStartE2EDuration="40.312867155s" totalImagesPullingTime="3.182773218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:56.312149409 +0000 UTC m=+71.053310844" watchObservedRunningTime="2026-09-09 23:48:56.312867155 +0000 UTC m=+71.054028588" Sep 09 23:48:57.019396 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.019366 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj"] Sep 09 23:48:57.022014 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.021981 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r"] Sep 09 23:48:57.022115 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.022100 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" Sep 09 23:48:57.024129 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.024110 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65645b54f6-w5c4r"] Sep 09 23:48:57.024250 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.024221 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.024890 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.024867 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.024999 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.024930 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-95ptq\"" Sep 09 23:48:57.025230 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.025214 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.026267 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026245 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5s2dr"] Sep 09 23:48:57.026455 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026439 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.026528 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026474 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.026571 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vscxc\"" Sep 09 23:48:57.026981 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026962 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 09 23:48:57.027072 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.026985 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.028217 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028198 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dznxx"] Sep 09 23:48:57.028330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028312 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.028411 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028394 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 09 23:48:57.028466 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028437 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-49ltj\"" Sep 09 23:48:57.028942 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028922 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.029045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.028980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.029045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.029024 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 09 23:48:57.029176 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.029158 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 09 23:48:57.029239 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.029230 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 09 23:48:57.031313 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.031293 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.031662 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.031645 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b94rz\"" Sep 09 23:48:57.031750 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.031715 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 09 23:48:57.032533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.031976 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.032533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.032180 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj"] Sep 09 23:48:57.032533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.032232 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 09 23:48:57.032533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.032386 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.033368 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.033348 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.034658 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.034425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 23:48:57.036929 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.036907 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 23:48:57.037228 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.037191 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.038185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.038143 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r"] Sep 09 23:48:57.038325 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.038306 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fhpx7\"" Sep 09 23:48:57.039476 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.039427 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dznxx"] Sep 09 23:48:57.041826 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.041019 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5s2dr"] Sep 09 23:48:57.041826 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.041583 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 09 23:48:57.053037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.053012 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 23:48:57.054850 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.054745 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65645b54f6-w5c4r"] Sep 09 23:48:57.088360 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088329 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cdgw\" (UniqueName: \"kubernetes.io/projected/0d35f060-7b6f-4945-972b-2fdf6a49b73d-kube-api-access-7cdgw\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.088360 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-serving-cert\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.088531 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d35f060-7b6f-4945-972b-2fdf6a49b73d-service-ca-bundle\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.088531 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e025681-d559-4b77-88b0-7a2764db1883-serving-cert\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.088531 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9xf\" (UniqueName: \"kubernetes.io/projected/2c272cfd-176e-430e-9b80-20761d627bfc-kube-api-access-8d9xf\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.088691 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088535 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-trusted-ca\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.088691 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-stats-auth\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.088691 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvhz\" (UniqueName: \"kubernetes.io/projected/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-kube-api-access-zbvhz\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.088691 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rq6\" (UniqueName: \"kubernetes.io/projected/0e025681-d559-4b77-88b0-7a2764db1883-kube-api-access-b7rq6\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-config\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-snapshots\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-metrics-certs\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c272cfd-176e-430e-9b80-20761d627bfc-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbjh\" (UniqueName: \"kubernetes.io/projected/24a841f0-f8a7-497f-8b56-e2e88ec071e8-kube-api-access-rxbjh\") pod \"volume-data-source-validator-695c895bd6-7tfkj\" (UID: \"24a841f0-f8a7-497f-8b56-e2e88ec071e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" Sep 09 23:48:57.088887 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-default-certificate\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.089071 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088900 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.089071 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-tmp\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.089071 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.088982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.118195 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.118174 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr"] Sep 09 23:48:57.120293 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.120279 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.122444 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.122426 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 23:48:57.122655 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.122640 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:48:57.122734 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.122665 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mdqhr\"" Sep 09 23:48:57.123055 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.123033 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:48:57.123793 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.123774 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 23:48:57.133162 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.133138 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr"] Sep 09 23:48:57.190199 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cdgw\" (UniqueName: \"kubernetes.io/projected/0d35f060-7b6f-4945-972b-2fdf6a49b73d-kube-api-access-7cdgw\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-serving-cert\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d35f060-7b6f-4945-972b-2fdf6a49b73d-service-ca-bundle\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63090ee5-7b5c-467d-87b4-438dac19c75a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e025681-d559-4b77-88b0-7a2764db1883-serving-cert\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9xf\" (UniqueName: \"kubernetes.io/projected/2c272cfd-176e-430e-9b80-20761d627bfc-kube-api-access-8d9xf\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.190311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-trusted-ca\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-stats-auth\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvhz\" (UniqueName: \"kubernetes.io/projected/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-kube-api-access-zbvhz\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rq6\" (UniqueName: \"kubernetes.io/projected/0e025681-d559-4b77-88b0-7a2764db1883-kube-api-access-b7rq6\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-config\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-snapshots\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.190613 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-metrics-certs\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.190891 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c272cfd-176e-430e-9b80-20761d627bfc-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.190937 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbjh\" (UniqueName: \"kubernetes.io/projected/24a841f0-f8a7-497f-8b56-e2e88ec071e8-kube-api-access-rxbjh\") pod \"volume-data-source-validator-695c895bd6-7tfkj\" (UID: \"24a841f0-f8a7-497f-8b56-e2e88ec071e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" Sep 09 23:48:57.190970 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-default-certificate\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.191019 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.191019 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.190995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63090ee5-7b5c-467d-87b4-438dac19c75a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.191119 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-tmp\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.191119 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpht\" (UniqueName: \"kubernetes.io/projected/63090ee5-7b5c-467d-87b4-438dac19c75a-kube-api-access-fgpht\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.191119 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.191263 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191226 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-config\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.191623 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191602 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-snapshots\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.191739 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191676 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e025681-d559-4b77-88b0-7a2764db1883-trusted-ca\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.191962 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-tmp\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.192095 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.191980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d35f060-7b6f-4945-972b-2fdf6a49b73d-service-ca-bundle\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.192198 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.192009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.192441 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.192416 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.193627 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.193604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-stats-auth\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.193735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.193642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e025681-d559-4b77-88b0-7a2764db1883-serving-cert\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.194075 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.194055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c272cfd-176e-430e-9b80-20761d627bfc-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.194187 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.194168 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-metrics-certs\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.194234 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.194198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-serving-cert\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.194271 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.194242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d35f060-7b6f-4945-972b-2fdf6a49b73d-default-certificate\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.205133 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.205115 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9xf\" (UniqueName: \"kubernetes.io/projected/2c272cfd-176e-430e-9b80-20761d627bfc-kube-api-access-8d9xf\") pod \"cluster-samples-operator-7cdcfcf76c-26m9r\" (UID: \"2c272cfd-176e-430e-9b80-20761d627bfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.205694 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.205673 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7rq6\" (UniqueName: \"kubernetes.io/projected/0e025681-d559-4b77-88b0-7a2764db1883-kube-api-access-b7rq6\") pod \"console-operator-85b454874b-dznxx\" (UID: \"0e025681-d559-4b77-88b0-7a2764db1883\") " pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.205818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.205710 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvhz\" (UniqueName: \"kubernetes.io/projected/89df1fbe-26b5-4f2b-8394-b19dbf1fe66c-kube-api-access-zbvhz\") pod \"insights-operator-76bcd6ccf5-5s2dr\" (UID: \"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.205818 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.205734 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cdgw\" (UniqueName: \"kubernetes.io/projected/0d35f060-7b6f-4945-972b-2fdf6a49b73d-kube-api-access-7cdgw\") pod \"router-default-65645b54f6-w5c4r\" (UID: \"0d35f060-7b6f-4945-972b-2fdf6a49b73d\") " pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.206545 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.206526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbjh\" (UniqueName: \"kubernetes.io/projected/24a841f0-f8a7-497f-8b56-e2e88ec071e8-kube-api-access-rxbjh\") pod \"volume-data-source-validator-695c895bd6-7tfkj\" (UID: \"24a841f0-f8a7-497f-8b56-e2e88ec071e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" Sep 09 23:48:57.291446 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.291388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63090ee5-7b5c-467d-87b4-438dac19c75a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.291446 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.291418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpht\" (UniqueName: \"kubernetes.io/projected/63090ee5-7b5c-467d-87b4-438dac19c75a-kube-api-access-fgpht\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.291777 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.291446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63090ee5-7b5c-467d-87b4-438dac19c75a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.292147 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.292122 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63090ee5-7b5c-467d-87b4-438dac19c75a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.293638 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.293621 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63090ee5-7b5c-467d-87b4-438dac19c75a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.301329 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.301306 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpht\" (UniqueName: \"kubernetes.io/projected/63090ee5-7b5c-467d-87b4-438dac19c75a-kube-api-access-fgpht\") pod \"cluster-monitoring-operator-6cdcc96965-wflpr\" (UID: \"63090ee5-7b5c-467d-87b4-438dac19c75a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.338168 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.338144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" Sep 09 23:48:57.345860 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.345837 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:57.356870 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.356854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" Sep 09 23:48:57.362708 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.362683 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" Sep 09 23:48:57.367851 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.367764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:48:57.429956 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.429918 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" Sep 09 23:48:57.619270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.619241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj"] Sep 09 23:48:57.622329 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:57.622301 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a841f0_f8a7_497f_8b56_e2e88ec071e8.slice/crio-65a022d0491610e08595cb7ad87da2368b1fbab1612ec7d7379af2f7ef39e4a8 WatchSource:0}: Error finding container 65a022d0491610e08595cb7ad87da2368b1fbab1612ec7d7379af2f7ef39e4a8: Status 404 returned error can't find the container with id 65a022d0491610e08595cb7ad87da2368b1fbab1612ec7d7379af2f7ef39e4a8 Sep 09 23:48:57.634122 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.634101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65645b54f6-w5c4r"] Sep 09 23:48:57.635791 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:57.635769 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d35f060_7b6f_4945_972b_2fdf6a49b73d.slice/crio-05ec1ae21697bd6ac0f43a2c9c949dfc192cd28572c092a657563aeba10b2203 WatchSource:0}: Error finding container 05ec1ae21697bd6ac0f43a2c9c949dfc192cd28572c092a657563aeba10b2203: Status 404 returned error can't find the container with id 05ec1ae21697bd6ac0f43a2c9c949dfc192cd28572c092a657563aeba10b2203 Sep 09 23:48:57.658719 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.658697 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5s2dr"] Sep 09 23:48:57.661669 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.661645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dznxx"] Sep 09 23:48:57.661923 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:57.661897 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89df1fbe_26b5_4f2b_8394_b19dbf1fe66c.slice/crio-dc1c6aeaf9ba1699aa7bb542de95f2dfbdbedd0b118957afb02cd6cedeb83cec WatchSource:0}: Error finding container dc1c6aeaf9ba1699aa7bb542de95f2dfbdbedd0b118957afb02cd6cedeb83cec: Status 404 returned error can't find the container with id dc1c6aeaf9ba1699aa7bb542de95f2dfbdbedd0b118957afb02cd6cedeb83cec Sep 09 23:48:57.663458 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.663435 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r"] Sep 09 23:48:57.667223 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:57.667201 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e025681_d559_4b77_88b0_7a2764db1883.slice/crio-326618fa9ca54f289a12441f63c4763b3f46947e030138072f70916e60410773 WatchSource:0}: Error finding container 326618fa9ca54f289a12441f63c4763b3f46947e030138072f70916e60410773: Status 404 returned error can't find the container with id 326618fa9ca54f289a12441f63c4763b3f46947e030138072f70916e60410773 Sep 09 23:48:57.715511 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:57.715485 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr"] Sep 09 23:48:57.718740 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:48:57.718705 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63090ee5_7b5c_467d_87b4_438dac19c75a.slice/crio-fee4b485c6619a29945a62ca5709217b8f9d5d0ee43974fc0056116d4b01255f WatchSource:0}: Error finding container fee4b485c6619a29945a62ca5709217b8f9d5d0ee43974fc0056116d4b01255f: Status 404 returned error can't find the container with id fee4b485c6619a29945a62ca5709217b8f9d5d0ee43974fc0056116d4b01255f Sep 09 23:48:58.291013 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.290974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" event={"ID":"24a841f0-f8a7-497f-8b56-e2e88ec071e8","Type":"ContainerStarted","Data":"65a022d0491610e08595cb7ad87da2368b1fbab1612ec7d7379af2f7ef39e4a8"} Sep 09 23:48:58.292576 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.292545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" event={"ID":"63090ee5-7b5c-467d-87b4-438dac19c75a","Type":"ContainerStarted","Data":"fee4b485c6619a29945a62ca5709217b8f9d5d0ee43974fc0056116d4b01255f"} Sep 09 23:48:58.294114 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.294084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" event={"ID":"2c272cfd-176e-430e-9b80-20761d627bfc","Type":"ContainerStarted","Data":"a6304e88be2d896dd629e3af496e56017be791fc6a680911f7249781f0e1c117"} Sep 09 23:48:58.296119 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.296089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65645b54f6-w5c4r" event={"ID":"0d35f060-7b6f-4945-972b-2fdf6a49b73d","Type":"ContainerStarted","Data":"daab25e403423a14803681493e465bd294fdfd41ce4e412a244a737f725df6fb"} Sep 09 23:48:58.296225 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.296128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65645b54f6-w5c4r" event={"ID":"0d35f060-7b6f-4945-972b-2fdf6a49b73d","Type":"ContainerStarted","Data":"05ec1ae21697bd6ac0f43a2c9c949dfc192cd28572c092a657563aeba10b2203"} Sep 09 23:48:58.297897 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.297876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" event={"ID":"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c","Type":"ContainerStarted","Data":"dc1c6aeaf9ba1699aa7bb542de95f2dfbdbedd0b118957afb02cd6cedeb83cec"} Sep 09 23:48:58.299228 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.299202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dznxx" event={"ID":"0e025681-d559-4b77-88b0-7a2764db1883","Type":"ContainerStarted","Data":"326618fa9ca54f289a12441f63c4763b3f46947e030138072f70916e60410773"} Sep 09 23:48:58.314272 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.314145 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65645b54f6-w5c4r" podStartSLOduration=2.314127468 podStartE2EDuration="2.314127468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:58.313177843 +0000 UTC m=+73.054339278" watchObservedRunningTime="2026-09-09 23:48:58.314127468 +0000 UTC m=+73.055288903" Sep 09 23:48:58.346742 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.346684 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:58.349786 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:58.349765 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:59.305638 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:59.305605 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:48:59.307126 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:48:59.307100 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65645b54f6-w5c4r" Sep 09 23:49:03.216868 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.216689 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v47s4"] Sep 09 23:49:03.237955 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.237923 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v47s4"] Sep 09 23:49:03.238128 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.238039 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.240895 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.240277 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:49:03.240895 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.240487 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:49:03.240895 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.240716 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rjj8g\"" Sep 09 23:49:03.322125 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.322087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" event={"ID":"89df1fbe-26b5-4f2b-8394-b19dbf1fe66c","Type":"ContainerStarted","Data":"b10935985461b612f8d847473ee5ee70caf90b7c1c1fdbe751a746493f1f1a7d"} Sep 09 23:49:03.323754 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.323726 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dznxx" event={"ID":"0e025681-d559-4b77-88b0-7a2764db1883","Type":"ContainerStarted","Data":"0a6bac941b783a920f74ef8cab804ebcdd34aa82a7caed0098c868f4cdb4bd88"} Sep 09 23:49:03.323924 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.323829 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:49:03.325507 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.325481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" event={"ID":"24a841f0-f8a7-497f-8b56-e2e88ec071e8","Type":"ContainerStarted","Data":"f05a8fc095dcec2a78f47c75505e0494772080a76dba502696ffd4dc24bf4902"} Sep 09 23:49:03.327186 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.327164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" event={"ID":"63090ee5-7b5c-467d-87b4-438dac19c75a","Type":"ContainerStarted","Data":"755c07a29b00ed48398098d5fcdaec51859e62e2f351d15930e16655143db4a7"} Sep 09 23:49:03.328808 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.328774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-dznxx" Sep 09 23:49:03.329350 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.329324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" event={"ID":"2c272cfd-176e-430e-9b80-20761d627bfc","Type":"ContainerStarted","Data":"02101d19d0fcbe11e02e02b62d1f32e621bbb4b0ef60ebdfa6a2e288a4065e8c"} Sep 09 23:49:03.329413 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.329360 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" event={"ID":"2c272cfd-176e-430e-9b80-20761d627bfc","Type":"ContainerStarted","Data":"6e8ac35a084a234eb805d49ecee51f1c87fa70d95b507af1e3c52a1b4b94e885"} Sep 09 23:49:03.343858 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.343836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-data-volume\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.343952 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.343876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s875\" (UniqueName: \"kubernetes.io/projected/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-api-access-5s875\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.343952 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.343936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-crio-socket\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.344046 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.344029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.344082 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.344062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.378884 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.378839 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7tfkj" podStartSLOduration=2.691711225 podStartE2EDuration="7.378822514s" totalImagesPullingTime="4.687111289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:03.378819131 +0000 UTC m=+78.119980566" watchObservedRunningTime="2026-09-09 23:49:03.378822514 +0000 UTC m=+78.119983949" Sep 09 23:49:03.379128 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.379100 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-5s2dr" podStartSLOduration=2.68545848 podStartE2EDuration="7.379090731s" totalImagesPullingTime="4.693632251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:03.353650648 +0000 UTC m=+78.094812083" watchObservedRunningTime="2026-09-09 23:49:03.379090731 +0000 UTC m=+78.120252173" Sep 09 23:49:03.398058 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.398011 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-wflpr" podStartSLOduration=1.760751838 podStartE2EDuration="6.397992834s" totalImagesPullingTime="4.637240996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:03.397327897 +0000 UTC m=+78.138489341" watchObservedRunningTime="2026-09-09 23:49:03.397992834 +0000 UTC m=+78.139154269" Sep 09 23:49:03.414809 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.414760 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-26m9r" podStartSLOduration=2.752293287 podStartE2EDuration="7.414741632s" totalImagesPullingTime="4.662448345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:03.413585069 +0000 UTC m=+78.154746494" watchObservedRunningTime="2026-09-09 23:49:03.414741632 +0000 UTC m=+78.155903064" Sep 09 23:49:03.429572 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.429528 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-dznxx" podStartSLOduration=2.735408332 podStartE2EDuration="7.429513987s" totalImagesPullingTime="4.694105655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:03.428808925 +0000 UTC m=+78.169970350" watchObservedRunningTime="2026-09-09 23:49:03.429513987 +0000 UTC m=+78.170675421" Sep 09 23:49:03.445122 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-crio-socket\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.445252 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445200 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-crio-socket\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.445369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.445503 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.445579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-data-volume\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.445654 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.445639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s875\" (UniqueName: \"kubernetes.io/projected/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-api-access-5s875\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.446330 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.446307 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.446448 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.446349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-data-volume\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.446448 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.446373 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:03.946354347 +0000 UTC m=+78.687515778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.446448 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.446420 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:03.446612 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.446478 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:03.946461544 +0000 UTC m=+78.687622970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : configmap "kube-rbac-proxy" not found Sep 09 23:49:03.456143 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.456119 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s875\" (UniqueName: \"kubernetes.io/projected/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-api-access-5s875\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.950630 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.950590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.950630 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:03.950643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:03.950835 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.950741 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:03.950835 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.950750 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.950835 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.950810 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.950782665 +0000 UTC m=+79.691944078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : configmap "kube-rbac-proxy" not found Sep 09 23:49:03.950835 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:03.950824 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.950818168 +0000 UTC m=+79.691979579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:04.199032 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:04.199002 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4grdz_4640a003-eace-4e71-91fa-dcd686e0e43f/dns/0.log" Sep 09 23:49:04.399334 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:04.399300 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4grdz_4640a003-eace-4e71-91fa-dcd686e0e43f/kube-rbac-proxy/0.log" Sep 09 23:49:04.960769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:04.960731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:04.960971 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:04.960779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:04.960971 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:04.960903 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:04.960971 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:04.960934 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:04.960971 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:04.960961 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:06.960946692 +0000 UTC m=+81.702108108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : configmap "kube-rbac-proxy" not found Sep 09 23:49:04.961143 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:04.961002 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls podName:b0020a6b-f918-47f9-96b0-2bd46f93ea8e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:06.960983939 +0000 UTC m=+81.702145354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v47s4" (UID: "b0020a6b-f918-47f9-96b0-2bd46f93ea8e") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:05.200698 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:05.200669 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cltlp_ebc61ebf-eb92-49da-a2d3-5284a489e1b3/dns-node-resolver/0.log" Sep 09 23:49:05.599479 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:05.599450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7665d5674d-nf9dg_45d1cda4-d228-4b5c-8a1b-f726a2ecb636/registry/0.log" Sep 09 23:49:06.199270 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.199244 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8fvsj_91908aac-1c5f-4654-9e20-46fcb13a8b40/node-ca/0.log" Sep 09 23:49:06.283283 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.283256 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4grdz" Sep 09 23:49:06.599989 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.599954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65645b54f6-w5c4r_0d35f060-7b6f-4945-972b-2fdf6a49b73d/router/0.log" Sep 09 23:49:06.799106 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.799079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6f4s2_9e3f4a25-b01d-4cbf-a585-f4369c79d73f/serve-healthcheck-canary/0.log" Sep 09 23:49:06.978579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.978494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:06.978579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.978542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:06.979084 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.979061 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:06.980843 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:06.980824 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0020a6b-f918-47f9-96b0-2bd46f93ea8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v47s4\" (UID: \"b0020a6b-f918-47f9-96b0-2bd46f93ea8e\") " pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:07.151499 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:07.151472 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v47s4" Sep 09 23:49:07.429659 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:07.429632 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v47s4"] Sep 09 23:49:07.432252 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:49:07.432219 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0020a6b_f918_47f9_96b0_2bd46f93ea8e.slice/crio-12ed1668f8828aa8538450959c1763467f62698f7d9741adaefd58980cdb98dd WatchSource:0}: Error finding container 12ed1668f8828aa8538450959c1763467f62698f7d9741adaefd58980cdb98dd: Status 404 returned error can't find the container with id 12ed1668f8828aa8538450959c1763467f62698f7d9741adaefd58980cdb98dd Sep 09 23:49:08.351397 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:08.351288 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v47s4" event={"ID":"b0020a6b-f918-47f9-96b0-2bd46f93ea8e","Type":"ContainerStarted","Data":"358f3cbf3a6f8a231891ba3be338e7d078bbc33fcbd04e87092af1b296560b98"} Sep 09 23:49:08.351397 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:08.351353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v47s4" event={"ID":"b0020a6b-f918-47f9-96b0-2bd46f93ea8e","Type":"ContainerStarted","Data":"12ed1668f8828aa8538450959c1763467f62698f7d9741adaefd58980cdb98dd"} Sep 09 23:49:09.358580 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:09.358539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v47s4" event={"ID":"b0020a6b-f918-47f9-96b0-2bd46f93ea8e","Type":"ContainerStarted","Data":"a64eaa1af6bc350cfd2670abfd106ea3cda79119b673c5a6807f660f70a5e9b1"} Sep 09 23:49:11.369108 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:11.369067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v47s4" event={"ID":"b0020a6b-f918-47f9-96b0-2bd46f93ea8e","Type":"ContainerStarted","Data":"efbb1b39da0ee3be173822d0c7198cb1083086eb6e2566ee04a2fb11e40cad6c"} Sep 09 23:49:11.387313 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:11.387264 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v47s4" podStartSLOduration=5.70325167 podStartE2EDuration="8.387250107s" totalImagesPullingTime="2.683998437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:49:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:11.385846639 +0000 UTC m=+86.127008074" watchObservedRunningTime="2026-09-09 23:49:11.387250107 +0000 UTC m=+86.128411540" Sep 09 23:49:12.110930 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:12.110888 2572 patch_prober.go:28] interesting pod/image-registry-7665d5674d-nf9dg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:49:12.111095 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:12.110946 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:49:13.398640 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.398603 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m6sxb"] Sep 09 23:49:13.402019 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.401997 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.404234 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.404211 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:49:13.404355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.404272 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:49:13.404617 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.404598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:49:13.405012 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.404995 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zrbrm\"" Sep 09 23:49:13.405095 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.405002 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:49:13.533177 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-tls\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-textfile\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-wtmp\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-root\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkhhn\" (UniqueName: \"kubernetes.io/projected/0034a79e-a2eb-487a-9428-f7c4aca831f2-kube-api-access-wkhhn\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-sys\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.533533 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.533461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-metrics-client-ca\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.634647 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.634617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-textfile\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.634843 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.634678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.634971 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.634950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-wtmp\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.635090 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-root\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.635205 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkhhn\" (UniqueName: \"kubernetes.io/projected/0034a79e-a2eb-487a-9428-f7c4aca831f2-kube-api-access-wkhhn\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.635322 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635109 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-textfile\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635080 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-wtmp\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-sys\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635140 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-root\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635504 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0034a79e-a2eb-487a-9428-f7c4aca831f2-sys\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-metrics-client-ca\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.635580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-tls\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636495 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.636064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.636495 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.636316 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0034a79e-a2eb-487a-9428-f7c4aca831f2-metrics-client-ca\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.638399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.638378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-tls\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.639052 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.639026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0034a79e-a2eb-487a-9428-f7c4aca831f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.643089 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.643068 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkhhn\" (UniqueName: \"kubernetes.io/projected/0034a79e-a2eb-487a-9428-f7c4aca831f2-kube-api-access-wkhhn\") pod \"node-exporter-m6sxb\" (UID: \"0034a79e-a2eb-487a-9428-f7c4aca831f2\") " pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.712016 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:13.711924 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6sxb" Sep 09 23:49:13.726144 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:49:13.726097 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0034a79e_a2eb_487a_9428_f7c4aca831f2.slice/crio-c1d9fd115f35151fbc3524b7ab7499b4c0d428875139467a281413975a01d1e8 WatchSource:0}: Error finding container c1d9fd115f35151fbc3524b7ab7499b4c0d428875139467a281413975a01d1e8: Status 404 returned error can't find the container with id c1d9fd115f35151fbc3524b7ab7499b4c0d428875139467a281413975a01d1e8 Sep 09 23:49:14.270455 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:14.270428 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:49:14.383867 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:14.383722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6sxb" event={"ID":"0034a79e-a2eb-487a-9428-f7c4aca831f2","Type":"ContainerStarted","Data":"c1d9fd115f35151fbc3524b7ab7499b4c0d428875139467a281413975a01d1e8"} Sep 09 23:49:15.390996 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:15.390959 2572 generic.go:356] "Generic (PLEG): container finished" podID="0034a79e-a2eb-487a-9428-f7c4aca831f2" containerID="835b11ba0d9287f72ae24fa4e7f4caf694e659f4a6c133a0ea92170fa457bded" exitCode=0 Sep 09 23:49:15.391460 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:15.391036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6sxb" event={"ID":"0034a79e-a2eb-487a-9428-f7c4aca831f2","Type":"ContainerDied","Data":"835b11ba0d9287f72ae24fa4e7f4caf694e659f4a6c133a0ea92170fa457bded"} Sep 09 23:49:16.399958 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:16.399915 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6sxb" event={"ID":"0034a79e-a2eb-487a-9428-f7c4aca831f2","Type":"ContainerStarted","Data":"d2f8be43b996bb663451b2e56ce1fe0131eb9d983a3c9b464479cc70fe1bab9e"} Sep 09 23:49:16.400431 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:16.400023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6sxb" event={"ID":"0034a79e-a2eb-487a-9428-f7c4aca831f2","Type":"ContainerStarted","Data":"3516bd00bb90ebb9674e34c401443bb3d307a33f529bcc9d21ee94fb12b9e925"} Sep 09 23:49:16.421910 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:16.421846 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m6sxb" podStartSLOduration=2.139063072 podStartE2EDuration="3.421830202s" totalImagesPullingTime="1.185213271s" totalInitContainerRuntime="97.553859ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:16.421429219 +0000 UTC m=+91.162590654" watchObservedRunningTime="2026-09-09 23:49:16.421830202 +0000 UTC m=+91.162991666" Sep 09 23:49:20.625727 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:20.625687 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:49:22.249008 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:22.248978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j4jx9" Sep 09 23:49:45.652027 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.651985 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerName="registry" containerID="cri-o://b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0" gracePeriod=30 Sep 09 23:49:45.891452 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.891423 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:49:45.975465 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975465 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975431 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npm4f\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975465 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975462 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975720 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975484 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975720 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975662 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975720 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975705 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975913 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975734 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.975913 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.975785 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") pod \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\" (UID: \"45d1cda4-d228-4b5c-8a1b-f726a2ecb636\") " Sep 09 23:49:45.977358 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.976060 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:49:45.977358 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.976078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:49:45.978267 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.978145 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:49:45.978267 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.978232 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:49:45.978267 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.978233 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f" (OuterVolumeSpecName: "kube-api-access-npm4f") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "kube-api-access-npm4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:49:45.978438 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.978272 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:49:45.978438 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.978425 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:49:45.984390 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:45.984364 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "45d1cda4-d228-4b5c-8a1b-f726a2ecb636" (UID: "45d1cda4-d228-4b5c-8a1b-f726a2ecb636"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:49:46.077072 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077041 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-certificates\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077072 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077067 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-installation-pull-secrets\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077106 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-ca-trust-extracted\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077119 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-registry-tls\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077131 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-bound-sa-token\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077143 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npm4f\" (UniqueName: \"kubernetes.io/projected/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-kube-api-access-npm4f\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077154 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-trusted-ca\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.077258 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.077166 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45d1cda4-d228-4b5c-8a1b-f726a2ecb636-image-registry-private-configuration\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:49:46.520068 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.520034 2572 generic.go:356] "Generic (PLEG): container finished" podID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerID="b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0" exitCode=0 Sep 09 23:49:46.520251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.520094 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" Sep 09 23:49:46.520251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.520122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" event={"ID":"45d1cda4-d228-4b5c-8a1b-f726a2ecb636","Type":"ContainerDied","Data":"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0"} Sep 09 23:49:46.520251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.520174 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7665d5674d-nf9dg" event={"ID":"45d1cda4-d228-4b5c-8a1b-f726a2ecb636","Type":"ContainerDied","Data":"e80a48a3e45dd3085cebce5e32bf18d1b9ea98965412c01aa5b12623868d4789"} Sep 09 23:49:46.520251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.520204 2572 scope.go:117] "RemoveContainer" containerID="b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0" Sep 09 23:49:46.529186 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.529168 2572 scope.go:117] "RemoveContainer" containerID="b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0" Sep 09 23:49:46.529433 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:49:46.529416 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0\": container with ID starting with b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0 not found: ID does not exist" containerID="b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0" Sep 09 23:49:46.529468 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.529440 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0"} err="failed to get container status \"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0\": rpc error: code = NotFound desc = could not find container \"b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0\": container with ID starting with b95b7f61a18f11cdeaf6c5fb41ea631e4a6db49c528063e12edc1a1661be16d0 not found: ID does not exist" Sep 09 23:49:46.539879 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.539857 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:49:46.543287 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:46.543268 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7665d5674d-nf9dg"] Sep 09 23:49:47.779691 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:49:47.779654 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" path="/var/lib/kubelet/pods/45d1cda4-d228-4b5c-8a1b-f726a2ecb636/volumes" Sep 09 23:50:10.363582 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.363544 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" podUID="48aa1643-0679-4cc6-8c38-35aaddbcd401" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:50:10.613150 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.613117 2572 generic.go:356] "Generic (PLEG): container finished" podID="bcfc5412-53b7-40f4-85f5-1962bd18251b" containerID="5747e35e3c207624b4aa7b43f619bd32a8ec4474e4a281e4a7d244457256de11" exitCode=0 Sep 09 23:50:10.613311 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.613191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" event={"ID":"bcfc5412-53b7-40f4-85f5-1962bd18251b","Type":"ContainerDied","Data":"5747e35e3c207624b4aa7b43f619bd32a8ec4474e4a281e4a7d244457256de11"} Sep 09 23:50:10.613562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.613536 2572 scope.go:117] "RemoveContainer" containerID="5747e35e3c207624b4aa7b43f619bd32a8ec4474e4a281e4a7d244457256de11" Sep 09 23:50:10.614730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.614705 2572 generic.go:356] "Generic (PLEG): container finished" podID="68a34b33-1fd3-4039-8476-dda226d26bae" containerID="2c04e411ba439775cfda49da50123653abb01c7d34cad714f583e0ed5ee1294e" exitCode=0 Sep 09 23:50:10.614932 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.614750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" event={"ID":"68a34b33-1fd3-4039-8476-dda226d26bae","Type":"ContainerDied","Data":"2c04e411ba439775cfda49da50123653abb01c7d34cad714f583e0ed5ee1294e"} Sep 09 23:50:10.615087 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:10.615069 2572 scope.go:117] "RemoveContainer" containerID="2c04e411ba439775cfda49da50123653abb01c7d34cad714f583e0ed5ee1294e" Sep 09 23:50:11.620778 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:11.620742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-5xdrk" event={"ID":"bcfc5412-53b7-40f4-85f5-1962bd18251b","Type":"ContainerStarted","Data":"65f305646d4ac3b1ae6a54354342149e5acc34eb775fb3599e082837df2220d1"} Sep 09 23:50:11.622491 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:11.622467 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zz8l5" event={"ID":"68a34b33-1fd3-4039-8476-dda226d26bae","Type":"ContainerStarted","Data":"6fe9d1f12736834365a9bfceff2ab59f84d56c369fb9320e94fed145088afe66"} Sep 09 23:50:20.363251 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:20.363211 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" podUID="48aa1643-0679-4cc6-8c38-35aaddbcd401" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:50:30.363565 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.363527 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" podUID="48aa1643-0679-4cc6-8c38-35aaddbcd401" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:50:30.363939 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.363594 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" Sep 09 23:50:30.364058 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.364041 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0c1af9f80d317606966d9de255ec9ae1776ca6a5e74582dab0d1f3d42eae38b1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 23:50:30.364094 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.364077 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" podUID="48aa1643-0679-4cc6-8c38-35aaddbcd401" containerName="service-proxy" containerID="cri-o://0c1af9f80d317606966d9de255ec9ae1776ca6a5e74582dab0d1f3d42eae38b1" gracePeriod=30 Sep 09 23:50:30.697960 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.697875 2572 generic.go:356] "Generic (PLEG): container finished" podID="48aa1643-0679-4cc6-8c38-35aaddbcd401" containerID="0c1af9f80d317606966d9de255ec9ae1776ca6a5e74582dab0d1f3d42eae38b1" exitCode=2 Sep 09 23:50:30.697960 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.697943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerDied","Data":"0c1af9f80d317606966d9de255ec9ae1776ca6a5e74582dab0d1f3d42eae38b1"} Sep 09 23:50:30.698132 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:50:30.697991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5fcb955f-brgjt" event={"ID":"48aa1643-0679-4cc6-8c38-35aaddbcd401","Type":"ContainerStarted","Data":"1911b7eccff2a46f2dbc25f620b7d3338f8780624478eac049c907f9afd39cd3"} Sep 09 23:52:34.760214 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.760175 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4"] Sep 09 23:52:34.760722 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.760633 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerName="registry" Sep 09 23:52:34.760722 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.760652 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerName="registry" Sep 09 23:52:34.760884 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.760736 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d1cda4-d228-4b5c-8a1b-f726a2ecb636" containerName="registry" Sep 09 23:52:34.763571 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.763551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.766012 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.765990 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:52:34.766130 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.765994 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:52:34.766130 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.766035 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:52:34.766248 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.766178 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hsxhq\"" Sep 09 23:52:34.766248 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.766209 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:52:34.777768 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.777743 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4"] Sep 09 23:52:34.789505 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.789480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.789626 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.789552 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.789626 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.789604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.789741 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.789672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.789741 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.789701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5mzh\" (UniqueName: \"kubernetes.io/projected/ac535597-8746-4672-95cc-17c61d2ef729-kube-api-access-d5mzh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890259 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890430 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5mzh\" (UniqueName: \"kubernetes.io/projected/ac535597-8746-4672-95cc-17c61d2ef729-kube-api-access-d5mzh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890430 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890430 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890430 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.890791 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.890752 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.892742 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.892706 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac535597-8746-4672-95cc-17c61d2ef729-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.892869 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.892770 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.892933 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.892885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac535597-8746-4672-95cc-17c61d2ef729-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:34.901097 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:34.901075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5mzh\" (UniqueName: \"kubernetes.io/projected/ac535597-8746-4672-95cc-17c61d2ef729-kube-api-access-d5mzh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-w5fz4\" (UID: \"ac535597-8746-4672-95cc-17c61d2ef729\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:35.073362 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:35.073296 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:35.351518 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:35.351489 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4"] Sep 09 23:52:35.354877 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:52:35.354847 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac535597_8746_4672_95cc_17c61d2ef729.slice/crio-763d12cd43d9d88da805f6d3bda8c74ecb87f3b2111a37e950ebb01cf7fecd1a WatchSource:0}: Error finding container 763d12cd43d9d88da805f6d3bda8c74ecb87f3b2111a37e950ebb01cf7fecd1a: Status 404 returned error can't find the container with id 763d12cd43d9d88da805f6d3bda8c74ecb87f3b2111a37e950ebb01cf7fecd1a Sep 09 23:52:36.156458 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:36.156418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" event={"ID":"ac535597-8746-4672-95cc-17c61d2ef729","Type":"ContainerStarted","Data":"763d12cd43d9d88da805f6d3bda8c74ecb87f3b2111a37e950ebb01cf7fecd1a"} Sep 09 23:52:39.172034 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:39.171990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" event={"ID":"ac535597-8746-4672-95cc-17c61d2ef729","Type":"ContainerStarted","Data":"313386b2c97f7fae3dc59ac1102b2d7a02bb38152b39d61775cd596961d6d18b"} Sep 09 23:52:40.176964 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:40.176929 2572 generic.go:356] "Generic (PLEG): container finished" podID="ac535597-8746-4672-95cc-17c61d2ef729" containerID="313386b2c97f7fae3dc59ac1102b2d7a02bb38152b39d61775cd596961d6d18b" exitCode=0 Sep 09 23:52:40.177330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:40.177018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" event={"ID":"ac535597-8746-4672-95cc-17c61d2ef729","Type":"ContainerDied","Data":"313386b2c97f7fae3dc59ac1102b2d7a02bb38152b39d61775cd596961d6d18b"} Sep 09 23:52:41.183493 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:41.183462 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" event={"ID":"ac535597-8746-4672-95cc-17c61d2ef729","Type":"ContainerStarted","Data":"a2f4aee576795b5975959129fee3af6d19ed124189422c5589c7cf9bc9cc7f3a"} Sep 09 23:52:41.183898 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:41.183589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:52:41.204346 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:41.204298 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" podStartSLOduration=2.808788317 podStartE2EDuration="7.20426284s" totalImagesPullingTime="3.305751857s" totalInitContainerRuntime="1.089722666s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:41.202343161 +0000 UTC m=+295.943504608" watchObservedRunningTime="2026-09-09 23:52:41.20426284 +0000 UTC m=+295.945424276" Sep 09 23:52:45.685117 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:45.685083 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:52:45.695264 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:45.695243 2572 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:52:45.695979 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:45.695956 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:52:52.189745 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:52:52.189714 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-w5fz4" Sep 09 23:53:12.833399 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.833361 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-qz2dl"] Sep 09 23:53:12.836394 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.836377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:12.839341 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.839320 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:53:12.840108 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.840089 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:53:12.840403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.840386 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:53:12.840461 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.840444 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:53:12.840513 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.840460 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:53:12.840513 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.840502 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shcl2\"" Sep 09 23:53:12.849892 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.849865 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-qz2dl"] Sep 09 23:53:12.956822 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.956776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4s5\" (UniqueName: \"kubernetes.io/projected/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-kube-api-access-7t4s5\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:12.956951 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.956847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:12.956951 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.956907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-manager-config\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:12.957048 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:12.956949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-metrics-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.057808 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.057782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-manager-config\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.057939 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.057839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-metrics-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.057939 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.057908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4s5\" (UniqueName: \"kubernetes.io/projected/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-kube-api-access-7t4s5\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.058050 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.057949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.058380 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.058360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-manager-config\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.060305 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.060281 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-metrics-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.060397 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.060319 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-cert\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.066692 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.066671 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4s5\" (UniqueName: \"kubernetes.io/projected/d2173db1-fb54-474a-bde2-9f7ec8c1e24c-kube-api-access-7t4s5\") pod \"lws-controller-manager-758756f974-qz2dl\" (UID: \"d2173db1-fb54-474a-bde2-9f7ec8c1e24c\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.145309 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.145275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:13.422913 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.422891 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-qz2dl"] Sep 09 23:53:13.425093 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:53:13.425066 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2173db1_fb54_474a_bde2_9f7ec8c1e24c.slice/crio-c9992d7ac55c792e77d8685cf174cd1baf9e6601ec25285003cddf1d88681daa WatchSource:0}: Error finding container c9992d7ac55c792e77d8685cf174cd1baf9e6601ec25285003cddf1d88681daa: Status 404 returned error can't find the container with id c9992d7ac55c792e77d8685cf174cd1baf9e6601ec25285003cddf1d88681daa Sep 09 23:53:13.426972 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:13.426953 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:53:14.318816 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:14.318768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" event={"ID":"d2173db1-fb54-474a-bde2-9f7ec8c1e24c","Type":"ContainerStarted","Data":"c9992d7ac55c792e77d8685cf174cd1baf9e6601ec25285003cddf1d88681daa"} Sep 09 23:53:16.330597 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:16.330508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" event={"ID":"d2173db1-fb54-474a-bde2-9f7ec8c1e24c","Type":"ContainerStarted","Data":"bdce6e8f84941cb3eb913201f8e3dab5cfc83d3349c8d148885d6155565b2598"} Sep 09 23:53:16.331051 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:16.330649 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:53:16.346193 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:16.346140 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" podStartSLOduration=1.816977981 podStartE2EDuration="4.346121275s" totalImagesPullingTime="2.529143294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:16.346088928 +0000 UTC m=+331.087250361" watchObservedRunningTime="2026-09-09 23:53:16.346121275 +0000 UTC m=+331.087282710" Sep 09 23:53:27.336564 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:53:27.336535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758756f974-qz2dl" Sep 09 23:55:14.413616 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.413545 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6"] Sep 09 23:55:14.416527 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.416511 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.419067 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.419048 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:55:14.419183 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.419133 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bqn76\"" Sep 09 23:55:14.419244 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.419220 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:55:14.433600 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.433578 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6"] Sep 09 23:55:14.473466 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.473439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.473574 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.473473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhcjg\" (UniqueName: \"kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.574168 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.574143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.574269 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.574172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhcjg\" (UniqueName: \"kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.574543 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.574524 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.583171 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.583144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhcjg\" (UniqueName: \"kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg\") pod \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:14.726091 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:14.725994 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:15.001357 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.001262 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6"] Sep 09 23:55:15.007359 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:55:15.007319 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4279af7_02c7_408f_94ae_a2d3977f3dbf.slice/crio-ea2c48def86dbc43364856dc6c5b2ef9f3462c48351cf664e222994db98e6bf2 WatchSource:0}: Error finding container ea2c48def86dbc43364856dc6c5b2ef9f3462c48351cf664e222994db98e6bf2: Status 404 returned error can't find the container with id ea2c48def86dbc43364856dc6c5b2ef9f3462c48351cf664e222994db98e6bf2 Sep 09 23:55:15.234345 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.234316 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6"] Sep 09 23:55:15.238700 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.238673 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6"] Sep 09 23:55:15.261317 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.261240 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:15.265477 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.265450 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.277700 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.277677 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:15.281573 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.281545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.281731 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.281593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65kl6\" (UniqueName: \"kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.382363 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.382324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.382363 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.382364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65kl6\" (UniqueName: \"kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.382764 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.382732 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.392934 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.392912 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65kl6\" (UniqueName: \"kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6\") pod \"kuadrant-operator-controller-manager-5f685c496f-v2vvk\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.575930 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.575848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:15.868357 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:15.868285 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:15.871916 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:55:15.871877 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201af1bf_bbd2_49cc_b188_3d7fb68d3a5a.slice/crio-ce19e97c5b9f03ac5b2f230e2caddd146a9a3c2efd3b7178be46caa47d727ecc WatchSource:0}: Error finding container ce19e97c5b9f03ac5b2f230e2caddd146a9a3c2efd3b7178be46caa47d727ecc: Status 404 returned error can't find the container with id ce19e97c5b9f03ac5b2f230e2caddd146a9a3c2efd3b7178be46caa47d727ecc Sep 09 23:55:16.832614 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:16.832574 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" event={"ID":"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a","Type":"ContainerStarted","Data":"ce19e97c5b9f03ac5b2f230e2caddd146a9a3c2efd3b7178be46caa47d727ecc"} Sep 09 23:55:20.855319 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:20.855266 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" containerName="manager" containerID="cri-o://c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595" gracePeriod=2 Sep 09 23:55:20.857269 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:20.857239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" event={"ID":"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a","Type":"ContainerStarted","Data":"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0"} Sep 09 23:55:20.857463 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:20.857439 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:20.879081 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:20.879037 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" podStartSLOduration=1.933333888 podStartE2EDuration="5.879022236s" totalImagesPullingTime="3.945688348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:55:20.876851308 +0000 UTC m=+455.618012736" watchObservedRunningTime="2026-09-09 23:55:20.879022236 +0000 UTC m=+455.620183670" Sep 09 23:55:21.091779 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.091751 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:21.093833 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:55:21.093783 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" is forbidden: User \"system:node:ip-10-0-142-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-137.ec2.internal' and this object" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:21.132409 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.132350 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhcjg\" (UniqueName: \"kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg\") pod \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " Sep 09 23:55:21.132518 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.132439 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume\") pod \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\" (UID: \"e4279af7-02c7-408f-94ae-a2d3977f3dbf\") " Sep 09 23:55:21.132702 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.132676 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4279af7-02c7-408f-94ae-a2d3977f3dbf" (UID: "e4279af7-02c7-408f-94ae-a2d3977f3dbf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:55:21.134424 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.134399 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg" (OuterVolumeSpecName: "kube-api-access-rhcjg") pod "e4279af7-02c7-408f-94ae-a2d3977f3dbf" (UID: "e4279af7-02c7-408f-94ae-a2d3977f3dbf"). InnerVolumeSpecName "kube-api-access-rhcjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:55:21.233832 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.233783 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhcjg\" (UniqueName: \"kubernetes.io/projected/e4279af7-02c7-408f-94ae-a2d3977f3dbf-kube-api-access-rhcjg\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:55:21.233832 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.233828 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4279af7-02c7-408f-94ae-a2d3977f3dbf-extensions-socket-volume\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:55:21.777739 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.777703 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" path="/var/lib/kubelet/pods/e4279af7-02c7-408f-94ae-a2d3977f3dbf/volumes" Sep 09 23:55:21.862248 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.862223 2572 generic.go:356] "Generic (PLEG): container finished" podID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" containerID="c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595" exitCode=2 Sep 09 23:55:21.862620 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.862259 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:21.862620 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.862320 2572 scope.go:117] "RemoveContainer" containerID="c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595" Sep 09 23:55:21.866200 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:55:21.866174 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-tp9k6\" is forbidden: User \"system:node:ip-10-0-142-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-137.ec2.internal' and this object" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tp9k6" Sep 09 23:55:21.870939 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.870924 2572 scope.go:117] "RemoveContainer" containerID="c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595" Sep 09 23:55:21.871210 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:55:21.871190 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595\": container with ID starting with c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595 not found: ID does not exist" containerID="c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595" Sep 09 23:55:21.871260 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:21.871218 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595"} err="failed to get container status \"c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595\": rpc error: code = NotFound desc = could not find container \"c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595\": container with ID starting with c80f351879266fdccbb20fc604164beba37da2ed32d318deedd7955cf93e6595 not found: ID does not exist" Sep 09 23:55:31.864792 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:31.864761 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:44.524025 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.523987 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:44.524509 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.524206 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" podUID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" containerName="manager" containerID="cri-o://fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0" gracePeriod=10 Sep 09 23:55:44.769856 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.769830 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:44.936792 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.936754 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65kl6\" (UniqueName: \"kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6\") pod \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " Sep 09 23:55:44.936989 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.936838 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume\") pod \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\" (UID: \"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a\") " Sep 09 23:55:44.937359 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.937326 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" (UID: "201af1bf-bbd2-49cc-b188-3d7fb68d3a5a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:55:44.938792 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.938774 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6" (OuterVolumeSpecName: "kube-api-access-65kl6") pod "201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" (UID: "201af1bf-bbd2-49cc-b188-3d7fb68d3a5a"). InnerVolumeSpecName "kube-api-access-65kl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:55:44.968318 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.968281 2572 generic.go:356] "Generic (PLEG): container finished" podID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" containerID="fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0" exitCode=0 Sep 09 23:55:44.968464 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.968333 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" Sep 09 23:55:44.968464 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.968403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" event={"ID":"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a","Type":"ContainerDied","Data":"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0"} Sep 09 23:55:44.968464 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.968445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk" event={"ID":"201af1bf-bbd2-49cc-b188-3d7fb68d3a5a","Type":"ContainerDied","Data":"ce19e97c5b9f03ac5b2f230e2caddd146a9a3c2efd3b7178be46caa47d727ecc"} Sep 09 23:55:44.968608 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.968471 2572 scope.go:117] "RemoveContainer" containerID="fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0" Sep 09 23:55:44.977247 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.977230 2572 scope.go:117] "RemoveContainer" containerID="fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0" Sep 09 23:55:44.977496 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:55:44.977470 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0\": container with ID starting with fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0 not found: ID does not exist" containerID="fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0" Sep 09 23:55:44.977587 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.977504 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0"} err="failed to get container status \"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0\": rpc error: code = NotFound desc = could not find container \"fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0\": container with ID starting with fa91fb82d780ebc13a8ddd63e608c60083add95474120ae4d2fbde73152863f0 not found: ID does not exist" Sep 09 23:55:44.992045 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.992017 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:44.996070 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:44.996048 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-v2vvk"] Sep 09 23:55:45.037809 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:45.037775 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65kl6\" (UniqueName: \"kubernetes.io/projected/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-kube-api-access-65kl6\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:55:45.037924 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:45.037815 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a-extensions-socket-volume\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:55:45.778882 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:45.778850 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" path="/var/lib/kubelet/pods/201af1bf-bbd2-49cc-b188-3d7fb68d3a5a/volumes" Sep 09 23:55:48.184355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184318 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59"] Sep 09 23:55:48.184842 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184769 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" containerName="manager" Sep 09 23:55:48.184842 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184788 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" containerName="manager" Sep 09 23:55:48.184842 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184837 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" containerName="manager" Sep 09 23:55:48.185010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184847 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" containerName="manager" Sep 09 23:55:48.185010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184934 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4279af7-02c7-408f-94ae-a2d3977f3dbf" containerName="manager" Sep 09 23:55:48.185010 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.184948 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="201af1bf-bbd2-49cc-b188-3d7fb68d3a5a" containerName="manager" Sep 09 23:55:48.192307 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.192282 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.194687 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.194665 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:55:48.194807 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.194665 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-56tsw\"" Sep 09 23:55:48.198037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.198014 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59"] Sep 09 23:55:48.365176 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365176 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365237 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df015f53-dc33-4dba-b6fc-472827722b28-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvlr\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-kube-api-access-vzvlr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365521 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df015f53-dc33-4dba-b6fc-472827722b28-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.365521 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.365448 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466696 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466737 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466772 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df015f53-dc33-4dba-b6fc-472827722b28-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466836 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvlr\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-kube-api-access-vzvlr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.466964 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466940 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df015f53-dc33-4dba-b6fc-472827722b28-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.466992 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.467021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467100 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.467066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467338 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.467328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.467584 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.467563 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df015f53-dc33-4dba-b6fc-472827722b28-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.468853 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.468831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df015f53-dc33-4dba-b6fc-472827722b28-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.469346 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.469325 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df015f53-dc33-4dba-b6fc-472827722b28-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.474651 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.474625 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvlr\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-kube-api-access-vzvlr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.474992 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.474970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df015f53-dc33-4dba-b6fc-472827722b28-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sns59\" (UID: \"df015f53-dc33-4dba-b6fc-472827722b28\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.504543 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.504519 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:48.775337 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.775280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59"] Sep 09 23:55:48.777726 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:55:48.777700 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf015f53_dc33_4dba_b6fc_472827722b28.slice/crio-0bfdffed7eb3f43ab69cb7c4ddaa8ef7615fd10fee80269929481f92eb2d9f4c WatchSource:0}: Error finding container 0bfdffed7eb3f43ab69cb7c4ddaa8ef7615fd10fee80269929481f92eb2d9f4c: Status 404 returned error can't find the container with id 0bfdffed7eb3f43ab69cb7c4ddaa8ef7615fd10fee80269929481f92eb2d9f4c Sep 09 23:55:48.986941 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:48.986905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" event={"ID":"df015f53-dc33-4dba-b6fc-472827722b28","Type":"ContainerStarted","Data":"0bfdffed7eb3f43ab69cb7c4ddaa8ef7615fd10fee80269929481f92eb2d9f4c"} Sep 09 23:55:52.112625 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:52.112560 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:55:52.112937 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:52.112660 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:55:52.112937 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:52.112692 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:55:53.006812 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:53.006757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" event={"ID":"df015f53-dc33-4dba-b6fc-472827722b28","Type":"ContainerStarted","Data":"47ef1308b6248a43e59ea5516dcae84dc57092c99210f610593ab36b5fdaea99"} Sep 09 23:55:53.025805 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:53.025746 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podStartSLOduration=1.69348965 podStartE2EDuration="5.025731097s" totalImagesPullingTime="3.332241447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:55:53.023590071 +0000 UTC m=+487.764751506" watchObservedRunningTime="2026-09-09 23:55:53.025731097 +0000 UTC m=+487.766892531" Sep 09 23:55:53.505681 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:53.505646 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:53.510426 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:53.510402 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:54.011303 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:54.011272 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:55:54.012159 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:55:54.012141 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:56:02.813334 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.813297 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:02.815622 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.815606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.818157 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.818130 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 23:56:02.818382 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.818358 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:56:02.818470 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.818451 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lqn7r\"" Sep 09 23:56:02.819252 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.819236 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:56:02.829065 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.829045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:02.877053 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.877010 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:02.883870 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.883839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.884004 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.883951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kc7v\" (UniqueName: \"kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.984735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.984699 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.984960 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.984759 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kc7v\" (UniqueName: \"kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.985419 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.985389 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:02.992105 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:02.992079 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kc7v\" (UniqueName: \"kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v\") pod \"limitador-limitador-8588749977-xv8vq\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:03.125564 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:03.125531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:03.399173 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:03.399141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:03.401729 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:56:03.401700 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716ad909_5965_4af8_a0ee_07ef09e7b49f.slice/crio-acc8cb7a8b3f00086dc90b92225af1f8be4ac25f7a7918fafab3342e36e8139d WatchSource:0}: Error finding container acc8cb7a8b3f00086dc90b92225af1f8be4ac25f7a7918fafab3342e36e8139d: Status 404 returned error can't find the container with id acc8cb7a8b3f00086dc90b92225af1f8be4ac25f7a7918fafab3342e36e8139d Sep 09 23:56:04.053460 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:04.053420 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" event={"ID":"716ad909-5965-4af8-a0ee-07ef09e7b49f","Type":"ContainerStarted","Data":"acc8cb7a8b3f00086dc90b92225af1f8be4ac25f7a7918fafab3342e36e8139d"} Sep 09 23:56:05.059424 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:05.059387 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" event={"ID":"716ad909-5965-4af8-a0ee-07ef09e7b49f","Type":"ContainerStarted","Data":"61c54fc407bc456ba89c9d808a925b72cb4a0217122229f08187c5bc001abd19"} Sep 09 23:56:05.059839 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:05.059518 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:05.075845 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:05.075782 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" podStartSLOduration=1.6158225000000002 podStartE2EDuration="3.075766571s" totalImagesPullingTime="1.459944071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:05.074627199 +0000 UTC m=+499.815788634" watchObservedRunningTime="2026-09-09 23:56:05.075766571 +0000 UTC m=+499.816928005" Sep 09 23:56:16.064580 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:16.064547 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:16.706213 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:16.706178 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:16.706388 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:16.706358 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" podUID="716ad909-5965-4af8-a0ee-07ef09e7b49f" containerName="limitador" containerID="cri-o://61c54fc407bc456ba89c9d808a925b72cb4a0217122229f08187c5bc001abd19" gracePeriod=30 Sep 09 23:56:17.110985 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.110952 2572 generic.go:356] "Generic (PLEG): container finished" podID="716ad909-5965-4af8-a0ee-07ef09e7b49f" containerID="61c54fc407bc456ba89c9d808a925b72cb4a0217122229f08187c5bc001abd19" exitCode=0 Sep 09 23:56:17.111463 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.111001 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" event={"ID":"716ad909-5965-4af8-a0ee-07ef09e7b49f","Type":"ContainerDied","Data":"61c54fc407bc456ba89c9d808a925b72cb4a0217122229f08187c5bc001abd19"} Sep 09 23:56:17.645123 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.645093 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:17.689652 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.689616 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file\") pod \"716ad909-5965-4af8-a0ee-07ef09e7b49f\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " Sep 09 23:56:17.689860 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.689715 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kc7v\" (UniqueName: \"kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v\") pod \"716ad909-5965-4af8-a0ee-07ef09e7b49f\" (UID: \"716ad909-5965-4af8-a0ee-07ef09e7b49f\") " Sep 09 23:56:17.690077 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.690052 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file" (OuterVolumeSpecName: "config-file") pod "716ad909-5965-4af8-a0ee-07ef09e7b49f" (UID: "716ad909-5965-4af8-a0ee-07ef09e7b49f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:56:17.691752 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.691730 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v" (OuterVolumeSpecName: "kube-api-access-4kc7v") pod "716ad909-5965-4af8-a0ee-07ef09e7b49f" (UID: "716ad909-5965-4af8-a0ee-07ef09e7b49f"). InnerVolumeSpecName "kube-api-access-4kc7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:56:17.791280 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.791250 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kc7v\" (UniqueName: \"kubernetes.io/projected/716ad909-5965-4af8-a0ee-07ef09e7b49f-kube-api-access-4kc7v\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:56:17.791280 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:17.791277 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/716ad909-5965-4af8-a0ee-07ef09e7b49f-config-file\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:56:18.116260 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:18.116230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" event={"ID":"716ad909-5965-4af8-a0ee-07ef09e7b49f","Type":"ContainerDied","Data":"acc8cb7a8b3f00086dc90b92225af1f8be4ac25f7a7918fafab3342e36e8139d"} Sep 09 23:56:18.116758 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:18.116284 2572 scope.go:117] "RemoveContainer" containerID="61c54fc407bc456ba89c9d808a925b72cb4a0217122229f08187c5bc001abd19" Sep 09 23:56:18.116758 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:18.116241 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xv8vq" Sep 09 23:56:18.131082 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:18.131054 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:18.134671 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:18.134649 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xv8vq"] Sep 09 23:56:19.778861 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:19.778824 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716ad909-5965-4af8-a0ee-07ef09e7b49f" path="/var/lib/kubelet/pods/716ad909-5965-4af8-a0ee-07ef09e7b49f/volumes" Sep 09 23:56:20.651279 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.651238 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf"] Sep 09 23:56:20.651567 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.651555 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716ad909-5965-4af8-a0ee-07ef09e7b49f" containerName="limitador" Sep 09 23:56:20.651611 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.651569 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="716ad909-5965-4af8-a0ee-07ef09e7b49f" containerName="limitador" Sep 09 23:56:20.651645 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.651616 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="716ad909-5965-4af8-a0ee-07ef09e7b49f" containerName="limitador" Sep 09 23:56:20.654430 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.654408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.656987 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.656964 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 09 23:56:20.656987 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.656965 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 09 23:56:20.657136 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.657027 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 09 23:56:20.657741 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.657721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rbn7w\"" Sep 09 23:56:20.662682 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.662658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf"] Sep 09 23:56:20.715546 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.715511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3649d820-fb02-4d93-91bb-6b9ee8f59eba-data\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.715718 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.715564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmgk6\" (UniqueName: \"kubernetes.io/projected/3649d820-fb02-4d93-91bb-6b9ee8f59eba-kube-api-access-tmgk6\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.817039 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.817011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3649d820-fb02-4d93-91bb-6b9ee8f59eba-data\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.817436 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.817050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmgk6\" (UniqueName: \"kubernetes.io/projected/3649d820-fb02-4d93-91bb-6b9ee8f59eba-kube-api-access-tmgk6\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.817503 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.817481 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3649d820-fb02-4d93-91bb-6b9ee8f59eba-data\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.824831 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.824810 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmgk6\" (UniqueName: \"kubernetes.io/projected/3649d820-fb02-4d93-91bb-6b9ee8f59eba-kube-api-access-tmgk6\") pod \"postgres-69fb4594cf-fw6kf\" (UID: \"3649d820-fb02-4d93-91bb-6b9ee8f59eba\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:20.966052 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:20.965964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:21.236418 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:21.236394 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf"] Sep 09 23:56:21.238853 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:56:21.238824 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3649d820_fb02_4d93_91bb_6b9ee8f59eba.slice/crio-06df3275232533ac21ddae214a9b056e2b8e23bda1facf5301e9fb5f53cc7d87 WatchSource:0}: Error finding container 06df3275232533ac21ddae214a9b056e2b8e23bda1facf5301e9fb5f53cc7d87: Status 404 returned error can't find the container with id 06df3275232533ac21ddae214a9b056e2b8e23bda1facf5301e9fb5f53cc7d87 Sep 09 23:56:22.135868 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:22.135835 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" event={"ID":"3649d820-fb02-4d93-91bb-6b9ee8f59eba","Type":"ContainerStarted","Data":"06df3275232533ac21ddae214a9b056e2b8e23bda1facf5301e9fb5f53cc7d87"} Sep 09 23:56:27.159813 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:27.159761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" event={"ID":"3649d820-fb02-4d93-91bb-6b9ee8f59eba","Type":"ContainerStarted","Data":"fe2220923623febfed14c9c146853d3cc3b8ab75bc73f395e6cedee6295546d6"} Sep 09 23:56:27.160322 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:27.159923 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:27.175328 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:27.175276 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" podStartSLOduration=2.099165909 podStartE2EDuration="7.175261006s" totalImagesPullingTime="5.076095097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:27.173737718 +0000 UTC m=+521.914899151" watchObservedRunningTime="2026-09-09 23:56:27.175261006 +0000 UTC m=+521.916422440" Sep 09 23:56:33.193921 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:33.193887 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fw6kf" Sep 09 23:56:40.464815 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.464719 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:40.467909 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.467891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.470619 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.470588 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 09 23:56:40.470759 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.470599 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-twjd8\"" Sep 09 23:56:40.470759 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.470681 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 09 23:56:40.471288 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.471271 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 09 23:56:40.480988 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.480966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:40.581579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.581539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.581579 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.581582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6c6\" (UniqueName: \"kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.581856 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.581654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.636029 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.635988 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f5c85f95-hctdf"] Sep 09 23:56:40.639417 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.639386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.648221 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.648198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c85f95-hctdf"] Sep 09 23:56:40.682735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.682703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.682735 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.682738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6c6\" (UniqueName: \"kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.682937 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.682788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.685367 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.685348 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.685429 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.685406 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.690525 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.690505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6c6\" (UniqueName: \"kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6\") pod \"maas-controller-6c46658578-wcj5x\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.778745 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.778654 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:40.784040 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.784017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-metrics-certs\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.784099 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.784066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-webhook-cert\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.784148 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.784124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnfd\" (UniqueName: \"kubernetes.io/projected/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-kube-api-access-cbnfd\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.884858 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.884790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-metrics-certs\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.885026 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.884871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-webhook-cert\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.885026 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.884902 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnfd\" (UniqueName: \"kubernetes.io/projected/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-kube-api-access-cbnfd\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.887344 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.887311 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-metrics-certs\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.887344 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.887338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-webhook-cert\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.892863 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.892839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnfd\" (UniqueName: \"kubernetes.io/projected/bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a-kube-api-access-cbnfd\") pod \"maas-controller-55f5c85f95-hctdf\" (UID: \"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a\") " pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:40.949468 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:40.949425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:41.049432 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:41.049406 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:41.051651 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:56:41.051626 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4da179d_f838_4c04_9eb7_9ec2fe0f3d03.slice/crio-eb197d3fb9afa86cea111d6791d21a1f26e785bca36e3480c0b2afbe401a0d88 WatchSource:0}: Error finding container eb197d3fb9afa86cea111d6791d21a1f26e785bca36e3480c0b2afbe401a0d88: Status 404 returned error can't find the container with id eb197d3fb9afa86cea111d6791d21a1f26e785bca36e3480c0b2afbe401a0d88 Sep 09 23:56:41.224443 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:41.224403 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c85f95-hctdf"] Sep 09 23:56:41.228365 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:41.228338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46658578-wcj5x" event={"ID":"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03","Type":"ContainerStarted","Data":"eb197d3fb9afa86cea111d6791d21a1f26e785bca36e3480c0b2afbe401a0d88"} Sep 09 23:56:41.230821 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:56:41.230782 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfe2e0e_f97d_41fb_b56f_8d7f54debf0a.slice/crio-b2da24b1c1688239f72e5fde12c3efd3ff5f35a53d7b8d4aa65b9cddcab62e52 WatchSource:0}: Error finding container b2da24b1c1688239f72e5fde12c3efd3ff5f35a53d7b8d4aa65b9cddcab62e52: Status 404 returned error can't find the container with id b2da24b1c1688239f72e5fde12c3efd3ff5f35a53d7b8d4aa65b9cddcab62e52 Sep 09 23:56:42.235856 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:42.235816 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c85f95-hctdf" event={"ID":"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a","Type":"ContainerStarted","Data":"b2da24b1c1688239f72e5fde12c3efd3ff5f35a53d7b8d4aa65b9cddcab62e52"} Sep 09 23:56:44.246047 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.246009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c85f95-hctdf" event={"ID":"bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a","Type":"ContainerStarted","Data":"af959b1e3b0dbcf15c580ea6c25bfbbce9ea24b832e5b653cd8fb9572bb1e76b"} Sep 09 23:56:44.246497 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.246130 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:44.247601 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.247576 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46658578-wcj5x" event={"ID":"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03","Type":"ContainerStarted","Data":"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb"} Sep 09 23:56:44.247730 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.247715 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:44.263492 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.263433 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f5c85f95-hctdf" podStartSLOduration=1.75800041 podStartE2EDuration="4.263421493s" totalImagesPullingTime="2.505421083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:44.262369754 +0000 UTC m=+539.003531196" watchObservedRunningTime="2026-09-09 23:56:44.263421493 +0000 UTC m=+539.004582926" Sep 09 23:56:44.278373 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:44.278328 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c46658578-wcj5x" podStartSLOduration=1.603534233 podStartE2EDuration="4.27831806s" totalImagesPullingTime="2.674783827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:56:44.277930834 +0000 UTC m=+539.019092269" watchObservedRunningTime="2026-09-09 23:56:44.27831806 +0000 UTC m=+539.019479494" Sep 09 23:56:55.254907 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:55.254872 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:55.255425 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:55.254945 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f5c85f95-hctdf" Sep 09 23:56:55.313206 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:55.313170 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:55.313380 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:55.313357 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c46658578-wcj5x" podUID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" containerName="manager" containerID="cri-o://7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb" gracePeriod=30 Sep 09 23:56:56.111562 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.111534 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:56.223422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.223331 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs\") pod \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " Sep 09 23:56:56.223422 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.223382 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert\") pod \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " Sep 09 23:56:56.223673 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.223449 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s6c6\" (UniqueName: \"kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6\") pod \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\" (UID: \"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03\") " Sep 09 23:56:56.225563 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.225535 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" (UID: "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:56:56.225675 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.225565 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" (UID: "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:56:56.225675 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.225637 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6" (OuterVolumeSpecName: "kube-api-access-6s6c6") pod "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" (UID: "c4da179d-f838-4c04-9eb7-9ec2fe0f3d03"). InnerVolumeSpecName "kube-api-access-6s6c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:56:56.301873 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.301838 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" containerID="7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb" exitCode=0 Sep 09 23:56:56.302266 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.301885 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c46658578-wcj5x" Sep 09 23:56:56.302266 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.301898 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46658578-wcj5x" event={"ID":"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03","Type":"ContainerDied","Data":"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb"} Sep 09 23:56:56.302266 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.301939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c46658578-wcj5x" event={"ID":"c4da179d-f838-4c04-9eb7-9ec2fe0f3d03","Type":"ContainerDied","Data":"eb197d3fb9afa86cea111d6791d21a1f26e785bca36e3480c0b2afbe401a0d88"} Sep 09 23:56:56.302266 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.301960 2572 scope.go:117] "RemoveContainer" containerID="7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb" Sep 09 23:56:56.311166 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.311146 2572 scope.go:117] "RemoveContainer" containerID="7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb" Sep 09 23:56:56.311470 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:56:56.311453 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb\": container with ID starting with 7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb not found: ID does not exist" containerID="7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb" Sep 09 23:56:56.311518 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.311479 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb"} err="failed to get container status \"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb\": rpc error: code = NotFound desc = could not find container \"7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb\": container with ID starting with 7578dfbc5ddf5418d51b7374c1b45d1f542b91a4f9b9570befab827837b5f7fb not found: ID does not exist" Sep 09 23:56:56.322356 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.322331 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:56.324353 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.324333 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-metrics-certs\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:56:56.324440 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.324357 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-webhook-cert\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:56:56.324440 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.324371 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s6c6\" (UniqueName: \"kubernetes.io/projected/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03-kube-api-access-6s6c6\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 09 23:56:56.326369 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:56.326349 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c46658578-wcj5x"] Sep 09 23:56:57.778162 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:56:57.778128 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" path="/var/lib/kubelet/pods/c4da179d-f838-4c04-9eb7-9ec2fe0f3d03/volumes" Sep 09 23:57:17.394736 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.394698 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz"] Sep 09 23:57:17.395318 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.395220 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" containerName="manager" Sep 09 23:57:17.395318 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.395240 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" containerName="manager" Sep 09 23:57:17.395435 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.395327 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4da179d-f838-4c04-9eb7-9ec2fe0f3d03" containerName="manager" Sep 09 23:57:17.399767 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.399746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.402165 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.402142 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 09 23:57:17.402271 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.402238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 09 23:57:17.402493 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.402477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n7hnl\"" Sep 09 23:57:17.410788 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.410765 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz"] Sep 09 23:57:17.506720 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.506684 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-metrics-certs\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.506720 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.506723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22lfj\" (UniqueName: \"kubernetes.io/projected/914037c9-b95d-41fc-89db-0732f255f153-kube-api-access-22lfj\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.507020 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.506817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/914037c9-b95d-41fc-89db-0732f255f153-openshift-service-ca\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.507020 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.506879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-maas-api-tls\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.607689 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.607655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/914037c9-b95d-41fc-89db-0732f255f153-openshift-service-ca\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.607908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.607734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-maas-api-tls\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.607908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.607755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-metrics-certs\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.607908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.607774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22lfj\" (UniqueName: \"kubernetes.io/projected/914037c9-b95d-41fc-89db-0732f255f153-kube-api-access-22lfj\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.608479 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.608448 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/914037c9-b95d-41fc-89db-0732f255f153-openshift-service-ca\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.610248 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.610226 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-metrics-certs\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.610341 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.610287 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/914037c9-b95d-41fc-89db-0732f255f153-maas-api-tls\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.620128 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.620108 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22lfj\" (UniqueName: \"kubernetes.io/projected/914037c9-b95d-41fc-89db-0732f255f153-kube-api-access-22lfj\") pod \"maas-api-6d4fd669db-jzdlz\" (UID: \"914037c9-b95d-41fc-89db-0732f255f153\") " pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:17.711437 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:17.711359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:18.004748 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.004671 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz"] Sep 09 23:57:18.007766 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:57:18.007734 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914037c9_b95d_41fc_89db_0732f255f153.slice/crio-5790375e894705bec32881f8fb43a64e6c63e75b3a2b33627ae66c578bfecd25 WatchSource:0}: Error finding container 5790375e894705bec32881f8fb43a64e6c63e75b3a2b33627ae66c578bfecd25: Status 404 returned error can't find the container with id 5790375e894705bec32881f8fb43a64e6c63e75b3a2b33627ae66c578bfecd25 Sep 09 23:57:18.237603 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.237570 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg"] Sep 09 23:57:18.243014 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.242991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.246467 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.246450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-d4pq8\"" Sep 09 23:57:18.247156 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.247140 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:57:18.258777 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.258721 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg"] Sep 09 23:57:18.314219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.314184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d315c97c-acfd-4514-8614-c16682d555db-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.314219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.314228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5jz\" (UniqueName: \"kubernetes.io/projected/d315c97c-acfd-4514-8614-c16682d555db-kube-api-access-fh5jz\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.393965 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.393930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" event={"ID":"914037c9-b95d-41fc-89db-0732f255f153","Type":"ContainerStarted","Data":"5790375e894705bec32881f8fb43a64e6c63e75b3a2b33627ae66c578bfecd25"} Sep 09 23:57:18.412987 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.412961 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xqdt6"] Sep 09 23:57:18.414932 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.414907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5jz\" (UniqueName: \"kubernetes.io/projected/d315c97c-acfd-4514-8614-c16682d555db-kube-api-access-fh5jz\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.415002 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.414993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d315c97c-acfd-4514-8614-c16682d555db-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.415605 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.415587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d315c97c-acfd-4514-8614-c16682d555db-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.416771 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.416755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.430651 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.430623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5jz\" (UniqueName: \"kubernetes.io/projected/d315c97c-acfd-4514-8614-c16682d555db-kube-api-access-fh5jz\") pod \"payload-pre-processing-59fbc47bf8-d9krg\" (UID: \"d315c97c-acfd-4514-8614-c16682d555db\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.436820 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.436783 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xqdt6"] Sep 09 23:57:18.516117 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.516039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/116a6d31-baf6-42f1-991c-6509b789d73e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.516117 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.516114 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbg5q\" (UniqueName: \"kubernetes.io/projected/116a6d31-baf6-42f1-991c-6509b789d73e-kube-api-access-vbg5q\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.552975 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.552941 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:18.617346 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.617311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/116a6d31-baf6-42f1-991c-6509b789d73e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.617483 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.617412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbg5q\" (UniqueName: \"kubernetes.io/projected/116a6d31-baf6-42f1-991c-6509b789d73e-kube-api-access-vbg5q\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.618106 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.618087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/116a6d31-baf6-42f1-991c-6509b789d73e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.640254 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.640225 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbg5q\" (UniqueName: \"kubernetes.io/projected/116a6d31-baf6-42f1-991c-6509b789d73e-kube-api-access-vbg5q\") pod \"payload-processing-5b54b7fbb7-xqdt6\" (UID: \"116a6d31-baf6-42f1-991c-6509b789d73e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.725724 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.725692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:18.842696 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:18.842672 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg"] Sep 09 23:57:18.844830 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:57:18.844790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd315c97c_acfd_4514_8614_c16682d555db.slice/crio-daacc84972a96f89140f74955e745d53d82e2f8deeffe3ce4c9f64760d79000b WatchSource:0}: Error finding container daacc84972a96f89140f74955e745d53d82e2f8deeffe3ce4c9f64760d79000b: Status 404 returned error can't find the container with id daacc84972a96f89140f74955e745d53d82e2f8deeffe3ce4c9f64760d79000b Sep 09 23:57:19.024841 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:19.024813 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xqdt6"] Sep 09 23:57:19.027258 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:57:19.027222 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116a6d31_baf6_42f1_991c_6509b789d73e.slice/crio-8a2ef142169743f9971d9d3ebdeb0237c47de8372c5e9c6d0002a4b9a91749f3 WatchSource:0}: Error finding container 8a2ef142169743f9971d9d3ebdeb0237c47de8372c5e9c6d0002a4b9a91749f3: Status 404 returned error can't find the container with id 8a2ef142169743f9971d9d3ebdeb0237c47de8372c5e9c6d0002a4b9a91749f3 Sep 09 23:57:19.400578 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:19.400532 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" event={"ID":"116a6d31-baf6-42f1-991c-6509b789d73e","Type":"ContainerStarted","Data":"8a2ef142169743f9971d9d3ebdeb0237c47de8372c5e9c6d0002a4b9a91749f3"} Sep 09 23:57:19.401943 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:19.401908 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" event={"ID":"d315c97c-acfd-4514-8614-c16682d555db","Type":"ContainerStarted","Data":"daacc84972a96f89140f74955e745d53d82e2f8deeffe3ce4c9f64760d79000b"} Sep 09 23:57:20.411527 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:20.411425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" event={"ID":"914037c9-b95d-41fc-89db-0732f255f153","Type":"ContainerStarted","Data":"498f31fe1709cef7b50c7e4c902496ff1b997a6ca540bf0df853f2ea84a92aca"} Sep 09 23:57:20.412324 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:20.412215 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:20.431616 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:20.430378 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" podStartSLOduration=1.312562169 podStartE2EDuration="3.430357403s" totalImagesPullingTime="2.117795234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:20.429016899 +0000 UTC m=+575.170178335" watchObservedRunningTime="2026-09-09 23:57:20.430357403 +0000 UTC m=+575.171518839" Sep 09 23:57:22.423539 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.423501 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" event={"ID":"116a6d31-baf6-42f1-991c-6509b789d73e","Type":"ContainerStarted","Data":"f20f324773938da44deda80a6c1e7e69d90a23564e619d93e3c81a9fe6e493a2"} Sep 09 23:57:22.424037 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.423710 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:22.425262 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.425243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" event={"ID":"d315c97c-acfd-4514-8614-c16682d555db","Type":"ContainerStarted","Data":"7c8f4680dac53d03d0e043a94be78432acc118d6e3f3c1f4bd1e28a3d3b4eb86"} Sep 09 23:57:22.425347 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.425301 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:22.439680 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.439637 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" podStartSLOduration=1.384817302 podStartE2EDuration="4.43962323s" totalImagesPullingTime="3.054805928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:22.438363576 +0000 UTC m=+577.179525009" watchObservedRunningTime="2026-09-09 23:57:22.43962323 +0000 UTC m=+577.180784664" Sep 09 23:57:22.453840 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:22.453761 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" podStartSLOduration=1.219086139 podStartE2EDuration="4.453743227s" totalImagesPullingTime="3.234657088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:22.453020117 +0000 UTC m=+577.194181552" watchObservedRunningTime="2026-09-09 23:57:22.453743227 +0000 UTC m=+577.194904662" Sep 09 23:57:27.431355 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:27.431323 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d4fd669db-jzdlz" Sep 09 23:57:28.454672 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.454641 2572 generic.go:356] "Generic (PLEG): container finished" podID="df015f53-dc33-4dba-b6fc-472827722b28" containerID="47ef1308b6248a43e59ea5516dcae84dc57092c99210f610593ab36b5fdaea99" exitCode=0 Sep 09 23:57:28.455186 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.454715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" event={"ID":"df015f53-dc33-4dba-b6fc-472827722b28","Type":"ContainerDied","Data":"47ef1308b6248a43e59ea5516dcae84dc57092c99210f610593ab36b5fdaea99"} Sep 09 23:57:28.455186 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.455108 2572 scope.go:117] "RemoveContainer" containerID="47ef1308b6248a43e59ea5516dcae84dc57092c99210f610593ab36b5fdaea99" Sep 09 23:57:28.461368 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.456333 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:57:28.461368 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.456504 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:57:28.461368 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:28.456593 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:57:29.464274 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:29.464228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" event={"ID":"df015f53-dc33-4dba-b6fc-472827722b28","Type":"ContainerStarted","Data":"289a1d0da9d75cbbba0e2e4720b3e43cf50d8e2fea6b7ce1a12d5b46b314f8f1"} Sep 09 23:57:29.505040 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:29.505007 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:57:29.505229 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:29.505208 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sns59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 09 23:57:29.505275 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:29.505255 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podUID="df015f53-dc33-4dba-b6fc-472827722b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 09 23:57:30.505728 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:30.505687 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sns59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 09 23:57:30.506130 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:30.505754 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podUID="df015f53-dc33-4dba-b6fc-472827722b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 09 23:57:31.505163 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:31.505129 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sns59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 09 23:57:31.505335 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:31.505180 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podUID="df015f53-dc33-4dba-b6fc-472827722b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 09 23:57:32.505714 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:32.505677 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sns59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 09 23:57:32.506125 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:32.505730 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podUID="df015f53-dc33-4dba-b6fc-472827722b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 09 23:57:33.433048 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:33.433011 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-d9krg" Sep 09 23:57:33.433211 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:33.433095 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xqdt6" Sep 09 23:57:33.505137 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:33.505104 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sns59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 09 23:57:33.505285 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:33.505161 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" podUID="df015f53-dc33-4dba-b6fc-472827722b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 09 23:57:34.763371 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:34.763330 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:57:34.763871 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:34.763832 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:57:34.765481 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:34.765451 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sns59" Sep 09 23:57:40.862547 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.862502 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz"] Sep 09 23:57:40.867292 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.867257 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.870714 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.870332 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shpnh\"" Sep 09 23:57:40.870714 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.870671 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:57:40.870954 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.870931 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:57:40.871453 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.871419 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 09 23:57:40.872047 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.872025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz"] Sep 09 23:57:40.941185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2sk9\" (UniqueName: \"kubernetes.io/projected/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-kube-api-access-m2sk9\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.941352 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.941352 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.941352 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.941352 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:40.941492 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:40.941366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041712 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041712 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041950 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041950 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2sk9\" (UniqueName: \"kubernetes.io/projected/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-kube-api-access-m2sk9\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041950 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.041950 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.041936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.042208 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.042184 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.042290 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.042217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.042336 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.042325 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.044157 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.044136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.044517 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.044498 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.049088 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.049066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2sk9\" (UniqueName: \"kubernetes.io/projected/8780caab-2ab0-4f94-9f29-5cc1cb8a424f-kube-api-access-m2sk9\") pod \"e2e-distinct-simulated-kserve-6685d86975-lc8pz\" (UID: \"8780caab-2ab0-4f94-9f29-5cc1cb8a424f\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.181014 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.180927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:41.450468 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.450391 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz"] Sep 09 23:57:41.453331 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:57:41.453305 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8780caab_2ab0_4f94_9f29_5cc1cb8a424f.slice/crio-c7076d3840c0eb551f4e4bcf2ace7f9e635a69c249975a232e1fd272ecdfa98b WatchSource:0}: Error finding container c7076d3840c0eb551f4e4bcf2ace7f9e635a69c249975a232e1fd272ecdfa98b: Status 404 returned error can't find the container with id c7076d3840c0eb551f4e4bcf2ace7f9e635a69c249975a232e1fd272ecdfa98b Sep 09 23:57:41.526967 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:41.526926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerStarted","Data":"c7076d3840c0eb551f4e4bcf2ace7f9e635a69c249975a232e1fd272ecdfa98b"} Sep 09 23:57:42.534118 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:42.534082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerStarted","Data":"19fae0312f5c18f90fe52cdb104b47cfe10320297fd250ccaa3285db2fe143f8"} Sep 09 23:57:42.550345 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:42.550278 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podStartSLOduration=1.58780329 podStartE2EDuration="2.550260325s" totalImagesPullingTime="962.457035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:57:42.550216116 +0000 UTC m=+597.291377551" watchObservedRunningTime="2026-09-09 23:57:42.550260325 +0000 UTC m=+597.291421740" Sep 09 23:57:43.541017 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:43.540982 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="19fae0312f5c18f90fe52cdb104b47cfe10320297fd250ccaa3285db2fe143f8" exitCode=0 Sep 09 23:57:43.541435 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:43.541070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"19fae0312f5c18f90fe52cdb104b47cfe10320297fd250ccaa3285db2fe143f8"} Sep 09 23:57:43.541435 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:43.541329 2572 scope.go:117] "RemoveContainer" containerID="19fae0312f5c18f90fe52cdb104b47cfe10320297fd250ccaa3285db2fe143f8" Sep 09 23:57:44.547400 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:44.547367 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" exitCode=0 Sep 09 23:57:44.547400 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:44.547405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54"} Sep 09 23:57:44.547949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:44.547450 2572 scope.go:117] "RemoveContainer" containerID="19fae0312f5c18f90fe52cdb104b47cfe10320297fd250ccaa3285db2fe143f8" Sep 09 23:57:44.547949 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:44.547764 2572 scope.go:117] "RemoveContainer" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" Sep 09 23:57:44.548051 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:57:44.548032 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:57:45.553956 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:45.553926 2572 scope.go:117] "RemoveContainer" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" Sep 09 23:57:45.554324 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:57:45.554099 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:57:45.720550 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:45.720522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:57:45.723024 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:45.722990 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 09 23:57:51.181655 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:51.181615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:51.182083 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:51.181677 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:51.182083 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:51.181693 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:51.182083 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:51.181708 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:57:51.182188 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:57:51.182098 2572 scope.go:117] "RemoveContainer" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" Sep 09 23:57:51.182291 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:57:51.182271 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:02.773403 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:02.773370 2572 scope.go:117] "RemoveContainer" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" Sep 09 23:58:03.634556 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:03.634523 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" exitCode=0 Sep 09 23:58:03.634733 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:03.634598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6"} Sep 09 23:58:03.634733 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:03.634659 2572 scope.go:117] "RemoveContainer" containerID="e3f646bccd60f438621a5f326cb5d73e9aa9f738f51f16db6356dbba2f300a54" Sep 09 23:58:03.634998 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:03.634983 2572 scope.go:117] "RemoveContainer" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" Sep 09 23:58:03.635217 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:03.635197 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:09.167427 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.167340 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj"] Sep 09 23:58:09.170908 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.170885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.173195 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.173175 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 23:58:09.178454 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.178431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj"] Sep 09 23:58:09.274599 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj58\" (UniqueName: \"kubernetes.io/projected/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-kube-api-access-bpj58\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.274774 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.274774 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.274774 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.274774 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.274945 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.274782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376160 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj58\" (UniqueName: \"kubernetes.io/projected/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-kube-api-access-bpj58\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376330 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376523 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376610 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376731 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376617 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.376731 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.376717 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.378526 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.378506 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.378852 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.378832 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.385202 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.385182 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj58\" (UniqueName: \"kubernetes.io/projected/2dd64483-ec66-4ae7-bdcc-3f3df7948bca-kube-api-access-bpj58\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w89xj\" (UID: \"2dd64483-ec66-4ae7-bdcc-3f3df7948bca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.483457 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.483368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:09.752731 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:09.752628 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj"] Sep 09 23:58:09.755196 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:58:09.755167 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd64483_ec66_4ae7_bdcc_3f3df7948bca.slice/crio-8e0b49e54da671545618b4063006d51a76838a5b4ba39b8f5fc9f18e5838d8b5 WatchSource:0}: Error finding container 8e0b49e54da671545618b4063006d51a76838a5b4ba39b8f5fc9f18e5838d8b5: Status 404 returned error can't find the container with id 8e0b49e54da671545618b4063006d51a76838a5b4ba39b8f5fc9f18e5838d8b5 Sep 09 23:58:10.670218 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:10.670183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" event={"ID":"2dd64483-ec66-4ae7-bdcc-3f3df7948bca","Type":"ContainerStarted","Data":"42533896bb448e50aa2c197f4e84d8ed688d364526462ad73f82d03d24ae19d5"} Sep 09 23:58:10.670622 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:10.670232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" event={"ID":"2dd64483-ec66-4ae7-bdcc-3f3df7948bca","Type":"ContainerStarted","Data":"8e0b49e54da671545618b4063006d51a76838a5b4ba39b8f5fc9f18e5838d8b5"} Sep 09 23:58:10.689196 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:10.689147 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" podStartSLOduration=1.524533189 podStartE2EDuration="1.689131793s" totalImagesPullingTime="164.598604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:58:10.686950692 +0000 UTC m=+625.428112120" watchObservedRunningTime="2026-09-09 23:58:10.689131793 +0000 UTC m=+625.430293227" Sep 09 23:58:11.181842 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.181781 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:11.182042 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.181879 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:11.182042 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.181905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:11.182042 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.181931 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:11.182319 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.182297 2572 scope.go:117] "RemoveContainer" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" Sep 09 23:58:11.182484 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:11.182465 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:11.674789 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:11.674763 2572 scope.go:117] "RemoveContainer" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" Sep 09 23:58:11.675188 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:11.674968 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:19.483705 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:19.483664 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:19.484120 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:19.483768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:19.496548 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:19.496521 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:19.720559 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:19.720530 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w89xj" Sep 09 23:58:23.772703 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:23.772660 2572 scope.go:117] "RemoveContainer" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" Sep 09 23:58:23.773180 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:23.773082 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:58:24.068022 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.067994 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr"] Sep 09 23:58:24.071575 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.071555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.073899 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.073876 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:58:24.082142 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.082119 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr"] Sep 09 23:58:24.208476 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.208643 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp7hf\" (UniqueName: \"kubernetes.io/projected/c9e3cd59-1f3d-4e7b-9030-37b28715c349-kube-api-access-vp7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.208643 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.208643 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.208643 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.208785 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.208714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309550 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309550 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp7hf\" (UniqueName: \"kubernetes.io/projected/c9e3cd59-1f3d-4e7b-9030-37b28715c349-kube-api-access-vp7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309550 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309875 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309875 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.309875 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.310054 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.309991 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.310054 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.310026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.310168 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.310078 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.311889 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.311869 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9e3cd59-1f3d-4e7b-9030-37b28715c349-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.312185 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.312166 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9e3cd59-1f3d-4e7b-9030-37b28715c349-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.317596 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.317571 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp7hf\" (UniqueName: \"kubernetes.io/projected/c9e3cd59-1f3d-4e7b-9030-37b28715c349-kube-api-access-vp7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr\" (UID: \"c9e3cd59-1f3d-4e7b-9030-37b28715c349\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.419987 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.419948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:24.692098 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.692074 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr"] Sep 09 23:58:24.694097 ip-10-0-142-137 kubenswrapper[2572]: W0909 23:58:24.694071 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e3cd59_1f3d_4e7b_9030_37b28715c349.slice/crio-7d0a409ff0dd218b77bd831f4bade5576b767708ed234dfb7eb662f4b200ef4f WatchSource:0}: Error finding container 7d0a409ff0dd218b77bd831f4bade5576b767708ed234dfb7eb662f4b200ef4f: Status 404 returned error can't find the container with id 7d0a409ff0dd218b77bd831f4bade5576b767708ed234dfb7eb662f4b200ef4f Sep 09 23:58:24.740128 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.740089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" event={"ID":"c9e3cd59-1f3d-4e7b-9030-37b28715c349","Type":"ContainerStarted","Data":"7d0a409ff0dd218b77bd831f4bade5576b767708ed234dfb7eb662f4b200ef4f"} Sep 09 23:58:24.741974 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.741939 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" exitCode=0 Sep 09 23:58:24.742120 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.741970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac"} Sep 09 23:58:24.742120 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.742028 2572 scope.go:117] "RemoveContainer" containerID="e030c0083585e900a895d41171b4fb0057263a2b1a51e4b5f7ea34c7327a0ed6" Sep 09 23:58:24.742387 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:24.742360 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:58:24.742646 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:24.742620 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:25.748522 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:25.748489 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" event={"ID":"c9e3cd59-1f3d-4e7b-9030-37b28715c349","Type":"ContainerStarted","Data":"9f5de3e25c7b61ee8ed4cc77d130e03c783fc09787fd9b06cf14a59be34d7949"} Sep 09 23:58:25.765462 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:25.765412 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" podStartSLOduration=1.580375337 podStartE2EDuration="1.765396203s" totalImagesPullingTime="185.020866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:58:25.764267734 +0000 UTC m=+640.505429167" watchObservedRunningTime="2026-09-09 23:58:25.765396203 +0000 UTC m=+640.506557636" Sep 09 23:58:31.181822 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.181756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:31.182219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.181869 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:31.182219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.181895 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:31.182219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.181912 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:58:31.182219 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.182202 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:58:31.182386 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:31.182367 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:31.779914 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:31.779876 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:58:31.780151 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:31.780125 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:34.420521 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:34.420485 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:34.421026 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:34.420559 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:34.432829 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:34.432785 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:34.803683 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:34.803587 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr" Sep 09 23:58:42.773148 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:42.773116 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:58:42.773518 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:42.773266 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:58:57.773361 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:58:57.773323 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:58:57.773744 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:58:57.773572 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:59:11.772757 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:11.772721 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:59:12.971387 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:12.971350 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" exitCode=0 Sep 09 23:59:12.971769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:12.971423 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb"} Sep 09 23:59:12.971769 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:12.971512 2572 scope.go:117] "RemoveContainer" containerID="2d46853404397fc51a22a4fed047523ecd0e5ef4d855d3f69ea3137ebb7082ac" Sep 09 23:59:12.971951 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:12.971932 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 09 23:59:12.972173 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:59:12.972154 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:59:21.181073 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:21.181032 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:59:21.181590 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:21.181097 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:59:21.181590 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:21.181120 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:59:21.181590 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:21.181139 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 09 23:59:21.181590 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:21.181584 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 09 23:59:21.181869 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:59:21.181846 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:59:31.772973 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:31.772938 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 09 23:59:31.773442 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:59:31.773160 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:59:42.772661 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:42.772582 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 09 23:59:42.773169 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:59:42.772765 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 09 23:59:53.772986 ip-10-0-142-137 kubenswrapper[2572]: I0909 23:59:53.772949 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 09 23:59:53.773454 ip-10-0-142-137 kubenswrapper[2572]: E0909 23:59:53.773211 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:00:00.145084 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.145046 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29816640-bdj46"] Sep 10 00:00:00.148778 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.148756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.150877 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.150851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Sep 10 00:00:00.151005 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.150860 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-thd2j\"" Sep 10 00:00:00.155901 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.155877 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29816640-bdj46"] Sep 10 00:00:00.250988 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.250952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.251143 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.251015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfk6h\" (UniqueName: \"kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.352300 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.352254 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.352452 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.352325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfk6h\" (UniqueName: \"kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.352952 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.352931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.360152 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.360124 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfk6h\" (UniqueName: \"kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h\") pod \"image-pruner-29816640-bdj46\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.476229 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.476136 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:00.744765 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:00.744706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29816640-bdj46"] Sep 10 00:00:00.746939 ip-10-0-142-137 kubenswrapper[2572]: W0910 00:00:00.746909 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b768451_bd05_41a4_b079_8204effa5a48.slice/crio-6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563 WatchSource:0}: Error finding container 6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563: Status 404 returned error can't find the container with id 6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563 Sep 10 00:00:01.194971 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:01.194941 2572 generic.go:356] "Generic (PLEG): container finished" podID="9b768451-bd05-41a4-b079-8204effa5a48" containerID="ce4d03f34901e1ee49f68e74b49fbb10be1214863c50f8608efd80cbfb87ef73" exitCode=0 Sep 10 00:00:01.195357 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:01.195028 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29816640-bdj46" event={"ID":"9b768451-bd05-41a4-b079-8204effa5a48","Type":"ContainerDied","Data":"ce4d03f34901e1ee49f68e74b49fbb10be1214863c50f8608efd80cbfb87ef73"} Sep 10 00:00:01.195357 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:01.195070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29816640-bdj46" event={"ID":"9b768451-bd05-41a4-b079-8204effa5a48","Type":"ContainerStarted","Data":"6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563"} Sep 10 00:00:02.339335 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.339307 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:02.479993 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.479895 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfk6h\" (UniqueName: \"kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h\") pod \"9b768451-bd05-41a4-b079-8204effa5a48\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " Sep 10 00:00:02.480136 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.480006 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca\") pod \"9b768451-bd05-41a4-b079-8204effa5a48\" (UID: \"9b768451-bd05-41a4-b079-8204effa5a48\") " Sep 10 00:00:02.480375 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.480355 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca" (OuterVolumeSpecName: "serviceca") pod "9b768451-bd05-41a4-b079-8204effa5a48" (UID: "9b768451-bd05-41a4-b079-8204effa5a48"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 00:00:02.481975 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.481942 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h" (OuterVolumeSpecName: "kube-api-access-cfk6h") pod "9b768451-bd05-41a4-b079-8204effa5a48" (UID: "9b768451-bd05-41a4-b079-8204effa5a48"). InnerVolumeSpecName "kube-api-access-cfk6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 00:00:02.580671 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.580637 2572 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b768451-bd05-41a4-b079-8204effa5a48-serviceca\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 10 00:00:02.580671 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:02.580666 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfk6h\" (UniqueName: \"kubernetes.io/projected/9b768451-bd05-41a4-b079-8204effa5a48-kube-api-access-cfk6h\") on node \"ip-10-0-142-137.ec2.internal\" DevicePath \"\"" Sep 10 00:00:03.204521 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:03.204486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29816640-bdj46" event={"ID":"9b768451-bd05-41a4-b079-8204effa5a48","Type":"ContainerDied","Data":"6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563"} Sep 10 00:00:03.204698 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:03.204543 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bcb530dd3dcecd37bf37254e9df03fb45cefc5d0b486dc38e8d92d845074563" Sep 10 00:00:03.204698 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:03.204494 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29816640-bdj46" Sep 10 00:00:07.773512 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:07.773479 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 10 00:00:07.773924 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:00:07.773649 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:00:22.773294 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:22.773254 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 10 00:00:22.773904 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:00:22.773428 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:00:35.775392 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:35.775359 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 10 00:00:36.359892 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:36.359857 2572 generic.go:356] "Generic (PLEG): container finished" podID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" exitCode=0 Sep 10 00:00:36.360054 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:36.359906 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" event={"ID":"8780caab-2ab0-4f94-9f29-5cc1cb8a424f","Type":"ContainerDied","Data":"a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242"} Sep 10 00:00:36.360054 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:36.359979 2572 scope.go:117] "RemoveContainer" containerID="f370fa8a9fbdacc00c09eeafaf22d5c6ae634fcab2c1e1999116b8f0726d30bb" Sep 10 00:00:36.360370 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:36.360349 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:00:36.360563 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:00:36.360541 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:00:41.181329 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:41.181290 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 10 00:00:41.181781 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:41.181362 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 10 00:00:41.181781 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:41.181379 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 10 00:00:41.181781 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:41.181392 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" Sep 10 00:00:41.181781 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:41.181763 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:00:41.182017 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:00:41.181995 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:00:52.773628 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:00:52.773597 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:00:52.774065 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:00:52.773759 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:01:03.773060 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:01:03.773024 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:01:03.773611 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:01:03.773267 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:01:14.773263 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:01:14.773182 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:01:14.773689 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:01:14.773379 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:01:29.778573 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:01:29.778542 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:01:29.779028 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:01:29.778694 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:01:43.773397 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:01:43.773364 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:01:43.773790 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:01:43.773540 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:01:54.773299 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:01:54.773264 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:01:54.773853 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:01:54.773445 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:02:06.772547 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:06.772517 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:02:06.773054 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:02:06.772700 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:02:21.773101 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:21.773068 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:02:21.773470 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:02:21.773288 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:02:36.773353 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:36.773317 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:02:36.775671 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:02:36.773525 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:02:38.025038 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:38.025006 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f5c85f95-hctdf_bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a/manager/0.log" Sep 10 00:02:38.636349 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:38.636278 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-w5fz4_ac535597-8746-4672-95cc-17c61d2ef729/copy-manifests/0.log" Sep 10 00:02:38.641723 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:38.641702 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-w5fz4_ac535597-8746-4672-95cc-17c61d2ef729/manager/0.log" Sep 10 00:02:38.972247 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:38.972175 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d4fd669db-jzdlz_914037c9-b95d-41fc-89db-0732f255f153/maas-api/0.log" Sep 10 00:02:39.209957 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:39.209917 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fw6kf_3649d820-fb02-4d93-91bb-6b9ee8f59eba/postgres/0.log" Sep 10 00:02:41.541351 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:41.541320 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/1.log" Sep 10 00:02:41.656650 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:41.656622 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-d9krg_d315c97c-acfd-4514-8614-c16682d555db/payload-pre-processing/0.log" Sep 10 00:02:41.771449 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:41.771418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xqdt6_116a6d31-baf6-42f1-991c-6509b789d73e/payload-processing/0.log" Sep 10 00:02:41.886986 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:41.886957 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65645b54f6-w5c4r_0d35f060-7b6f-4945-972b-2fdf6a49b73d/router/0.log" Sep 10 00:02:42.357306 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:42.357281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-lc8pz_8780caab-2ab0-4f94-9f29-5cc1cb8a424f/main/5.log" Sep 10 00:02:42.578149 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:42.578126 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-w89xj_2dd64483-ec66-4ae7-bdcc-3f3df7948bca/main/0.log" Sep 10 00:02:42.704224 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:42.704146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdtxkr_c9e3cd59-1f3d-4e7b-9030-37b28715c349/main/0.log" Sep 10 00:02:45.757596 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:45.757568 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 10 00:02:45.758074 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:45.757790 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 10 00:02:50.772924 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:50.772890 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:02:50.773308 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:02:50.773068 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:02:51.761230 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:51.761200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v2dpx_572a8f87-4f72-4cd1-917d-53e18972aa49/global-pull-secret-syncer/0.log" Sep 10 00:02:51.829685 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:51.829654 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mnt9f_d61c0dba-e1c6-4cad-a111-f19a5d9471f7/konnectivity-agent/0.log" Sep 10 00:02:51.921232 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:51.921192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-137.ec2.internal_2be7ae5f8aa68bc3268930762bd5fa5d/haproxy/0.log" Sep 10 00:02:58.360189 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:58.360156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-wflpr_63090ee5-7b5c-467d-87b4-438dac19c75a/cluster-monitoring-operator/0.log" Sep 10 00:02:58.685460 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:58.685434 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6sxb_0034a79e-a2eb-487a-9428-f7c4aca831f2/node-exporter/0.log" Sep 10 00:02:58.707881 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:58.707858 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6sxb_0034a79e-a2eb-487a-9428-f7c4aca831f2/kube-rbac-proxy/0.log" Sep 10 00:02:58.728628 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:02:58.728607 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6sxb_0034a79e-a2eb-487a-9428-f7c4aca831f2/init-textfile/0.log" Sep 10 00:03:00.561584 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:00.561553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-tk28q_169ec6e8-392c-4150-8bd7-1af8527f0f8e/networking-console-plugin/0.log" Sep 10 00:03:01.154318 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:01.154289 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dznxx_0e025681-d559-4b77-88b0-7a2764db1883/console-operator/0.log" Sep 10 00:03:02.324838 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.324807 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk"] Sep 10 00:03:02.325197 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.325167 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b768451-bd05-41a4-b079-8204effa5a48" containerName="image-pruner" Sep 10 00:03:02.325197 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.325177 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b768451-bd05-41a4-b079-8204effa5a48" containerName="image-pruner" Sep 10 00:03:02.325268 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.325241 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b768451-bd05-41a4-b079-8204effa5a48" containerName="image-pruner" Sep 10 00:03:02.328581 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.328561 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.330536 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.330515 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6zkw7\"/\"default-dockercfg-rgfzf\"" Sep 10 00:03:02.331311 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.331296 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zkw7\"/\"kube-root-ca.crt\"" Sep 10 00:03:02.331407 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.331326 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zkw7\"/\"openshift-service-ca.crt\"" Sep 10 00:03:02.337697 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.337675 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk"] Sep 10 00:03:02.338094 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.338072 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-7tfkj_24a841f0-f8a7-497f-8b56-e2e88ec071e8/volume-data-source-validator/0.log" Sep 10 00:03:02.445507 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.445471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-lib-modules\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.445668 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.445522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-sys\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.445668 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.445537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-podres\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.445668 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.445624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvsr\" (UniqueName: \"kubernetes.io/projected/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-kube-api-access-xjvsr\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.445668 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.445658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-proc\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546289 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-lib-modules\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546423 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-sys\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546423 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-podres\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546423 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvsr\" (UniqueName: \"kubernetes.io/projected/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-kube-api-access-xjvsr\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546423 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-proc\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546423 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-sys\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546583 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-lib-modules\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546583 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-proc\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.546583 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.546511 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-podres\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.554256 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.554234 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvsr\" (UniqueName: \"kubernetes.io/projected/d7939e1b-536f-4d4c-95b1-9e1afd6cbc13-kube-api-access-xjvsr\") pod \"perf-node-gather-daemonset-ghmbk\" (UID: \"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.639060 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.639032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:02.773284 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.773253 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:03:02.773442 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:03:02.773427 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:03:02.909693 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:02.909667 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk"] Sep 10 00:03:02.911918 ip-10-0-142-137 kubenswrapper[2572]: W0910 00:03:02.911893 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7939e1b_536f_4d4c_95b1_9e1afd6cbc13.slice/crio-cde3822ea0677efb70bfc6466578bb9fdb31b8d673575ecc92e453aab6403c0f WatchSource:0}: Error finding container cde3822ea0677efb70bfc6466578bb9fdb31b8d673575ecc92e453aab6403c0f: Status 404 returned error can't find the container with id cde3822ea0677efb70bfc6466578bb9fdb31b8d673575ecc92e453aab6403c0f Sep 10 00:03:03.041980 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.041941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" event={"ID":"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13","Type":"ContainerStarted","Data":"900e9847a83dca0156d0a53a38a3a18c7333769c4effc159fdbc0d13754b634a"} Sep 10 00:03:03.042171 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.042037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" event={"ID":"d7939e1b-536f-4d4c-95b1-9e1afd6cbc13","Type":"ContainerStarted","Data":"cde3822ea0677efb70bfc6466578bb9fdb31b8d673575ecc92e453aab6403c0f"} Sep 10 00:03:03.042171 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.042066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:03.056876 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.056827 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" podStartSLOduration=1.056808817 podStartE2EDuration="1.056808817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:03:03.055396221 +0000 UTC m=+917.796557656" watchObservedRunningTime="2026-09-10 00:03:03.056808817 +0000 UTC m=+917.797970247" Sep 10 00:03:03.451994 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.451962 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4grdz_4640a003-eace-4e71-91fa-dcd686e0e43f/dns/0.log" Sep 10 00:03:03.470893 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.470858 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4grdz_4640a003-eace-4e71-91fa-dcd686e0e43f/kube-rbac-proxy/0.log" Sep 10 00:03:03.562681 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:03.562650 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cltlp_ebc61ebf-eb92-49da-a2d3-5284a489e1b3/dns-node-resolver/0.log" Sep 10 00:03:04.081549 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:04.081519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29816640-bdj46_9b768451-bd05-41a4-b079-8204effa5a48/image-pruner/0.log" Sep 10 00:03:04.161226 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:04.161187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8fvsj_91908aac-1c5f-4654-9e20-46fcb13a8b40/node-ca/0.log" Sep 10 00:03:05.195924 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.195895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/1.log" Sep 10 00:03:05.196288 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.196195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/0.log" Sep 10 00:03:05.216329 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.216303 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-d9krg_d315c97c-acfd-4514-8614-c16682d555db/payload-pre-processing/0.log" Sep 10 00:03:05.239394 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.239365 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xqdt6_116a6d31-baf6-42f1-991c-6509b789d73e/payload-processing/0.log" Sep 10 00:03:05.262139 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.262114 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65645b54f6-w5c4r_0d35f060-7b6f-4945-972b-2fdf6a49b73d/router/0.log" Sep 10 00:03:05.841674 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:05.841648 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6f4s2_9e3f4a25-b01d-4cbf-a585-f4369c79d73f/serve-healthcheck-canary/0.log" Sep 10 00:03:06.324117 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:06.324086 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-5s2dr_89df1fbe-26b5-4f2b-8394-b19dbf1fe66c/insights-operator/0.log" Sep 10 00:03:06.465011 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:06.464980 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v47s4_b0020a6b-f918-47f9-96b0-2bd46f93ea8e/kube-rbac-proxy/0.log" Sep 10 00:03:06.486054 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:06.486023 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v47s4_b0020a6b-f918-47f9-96b0-2bd46f93ea8e/exporter/0.log" Sep 10 00:03:06.505745 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:06.505720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v47s4_b0020a6b-f918-47f9-96b0-2bd46f93ea8e/extractor/0.log" Sep 10 00:03:08.596879 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:08.596852 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f5c85f95-hctdf_bcfe2e0e-f97d-41fb-b56f-8d7f54debf0a/manager/0.log" Sep 10 00:03:08.819419 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:08.819389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-w5fz4_ac535597-8746-4672-95cc-17c61d2ef729/manager/0.log" Sep 10 00:03:08.837290 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:08.837268 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-w5fz4_ac535597-8746-4672-95cc-17c61d2ef729/copy-manifests/0.log" Sep 10 00:03:09.056762 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:09.056688 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-ghmbk" Sep 10 00:03:09.933901 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:09.933870 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758756f974-qz2dl_d2173db1-fb54-474a-bde2-9f7ec8c1e24c/manager/0.log" Sep 10 00:03:11.954129 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:11.954060 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/1.log" Sep 10 00:03:11.954509 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:11.954406 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/0.log" Sep 10 00:03:11.964644 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:11.964620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-d9krg_d315c97c-acfd-4514-8614-c16682d555db/payload-pre-processing/0.log" Sep 10 00:03:11.978906 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:11.978887 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xqdt6_116a6d31-baf6-42f1-991c-6509b789d73e/payload-processing/0.log" Sep 10 00:03:12.003982 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:12.003960 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65645b54f6-w5c4r_0d35f060-7b6f-4945-972b-2fdf6a49b73d/router/0.log" Sep 10 00:03:13.194864 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:13.194837 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/1.log" Sep 10 00:03:13.195285 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:13.195183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sns59_df015f53-dc33-4dba-b6fc-472827722b28/istio-proxy/0.log" Sep 10 00:03:13.205749 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:13.205725 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-d9krg_d315c97c-acfd-4514-8614-c16682d555db/payload-pre-processing/0.log" Sep 10 00:03:13.222643 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:13.222624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xqdt6_116a6d31-baf6-42f1-991c-6509b789d73e/payload-processing/0.log" Sep 10 00:03:13.246001 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:13.245979 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65645b54f6-w5c4r_0d35f060-7b6f-4945-972b-2fdf6a49b73d/router/0.log" Sep 10 00:03:14.773479 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:14.773450 2572 scope.go:117] "RemoveContainer" containerID="a12812cbd2755527bd3f397e6feae1c8f3ef723d9837f45c63f2f791e11a2242" Sep 10 00:03:14.773862 ip-10-0-142-137 kubenswrapper[2572]: E0910 00:03:14.773648 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-lc8pz_llm(8780caab-2ab0-4f94-9f29-5cc1cb8a424f)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-lc8pz" podUID="8780caab-2ab0-4f94-9f29-5cc1cb8a424f" Sep 10 00:03:15.156291 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:15.156234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-sk996_ee723837-4f4c-45ad-bcc2-8efc41c72197/migrator/0.log" Sep 10 00:03:15.176820 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:15.176776 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-sk996_ee723837-4f4c-45ad-bcc2-8efc41c72197/graceful-termination/0.log" Sep 10 00:03:15.516981 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:15.516903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-5xdrk_bcfc5412-53b7-40f4-85f5-1962bd18251b/kube-storage-version-migrator-operator/1.log" Sep 10 00:03:15.517738 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:15.517711 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-5xdrk_bcfc5412-53b7-40f4-85f5-1962bd18251b/kube-storage-version-migrator-operator/0.log" Sep 10 00:03:16.758662 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.758631 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/kube-multus-additional-cni-plugins/0.log" Sep 10 00:03:16.778546 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.778523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/egress-router-binary-copy/0.log" Sep 10 00:03:16.797543 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.797520 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/cni-plugins/0.log" Sep 10 00:03:16.816115 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.816091 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/bond-cni-plugin/0.log" Sep 10 00:03:16.835218 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.835194 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/routeoverride-cni/0.log" Sep 10 00:03:16.853081 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.853053 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/whereabouts-cni-bincopy/0.log" Sep 10 00:03:16.871866 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.871827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w4j49_c73eea75-8d69-4bf2-a263-d4488cd4b24d/whereabouts-cni/0.log" Sep 10 00:03:16.902627 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.902599 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mh8gg_71ed049b-dd35-4832-b59f-4d5f2e2795e6/kube-multus/0.log" Sep 10 00:03:16.953831 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.953788 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8j4qg_db5d618c-7cb8-4d74-8fe9-c1611be41dcd/network-metrics-daemon/0.log" Sep 10 00:03:16.973233 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:16.973207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8j4qg_db5d618c-7cb8-4d74-8fe9-c1611be41dcd/kube-rbac-proxy/0.log" Sep 10 00:03:18.164045 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.164019 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-controller/0.log" Sep 10 00:03:18.184598 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.184571 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/1.log" Sep 10 00:03:18.184755 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.184617 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovn-acl-logging/0.log" Sep 10 00:03:18.201653 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.201628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/kube-rbac-proxy-node/0.log" Sep 10 00:03:18.220865 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.220842 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 00:03:18.237068 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.237044 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/northd/0.log" Sep 10 00:03:18.257155 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.257132 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/nbdb/0.log" Sep 10 00:03:18.276219 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.276201 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/sbdb/0.log" Sep 10 00:03:18.315157 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:18.315136 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-std7w_0183007c-8422-420d-81bd-ffb8f5402c74/ovnkube-controller/0.log" Sep 10 00:03:19.344584 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:19.344548 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-6jffs_f77d3ef0-05eb-447c-b7f7-1ef48fb03140/check-endpoints/0.log" Sep 10 00:03:19.382552 ip-10-0-142-137 kubenswrapper[2572]: I0910 00:03:19.382518 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-j4jx9_a8f14dc2-9352-4960-9249-c469f4671af8/network-check-target-container/0.log"