Sep 08 02:19:06.532353 ip-10-0-142-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 08 02:19:06.532628 ip-10-0-142-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 08 02:19:06.532728 ip-10-0-142-110 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 08 02:19:06.533260 ip-10-0-142-110 systemd[1]: Failed to start Kubernetes Kubelet. Sep 08 02:19:16.575560 ip-10-0-142-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 08 02:19:16.575579 ip-10-0-142-110 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e985b80904544275a93686ec0b2bd31f -- Sep 08 02:20:49.021500 ip-10-0-142-110 systemd[1]: Starting Kubernetes Kubelet... Sep 08 02:20:49.455742 ip-10-0-142-110 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:20:49.455742 ip-10-0-142-110 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 02:20:49.455742 ip-10-0-142-110 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:20:49.455742 ip-10-0-142-110 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 02:20:49.455742 ip-10-0-142-110 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 02:20:49.458544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.458461 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 02:20:49.463425 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463399 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.463425 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463424 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.463425 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463430 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463435 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463441 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463445 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463456 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463460 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463465 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463471 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463475 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463479 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463483 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463488 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463497 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463502 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463506 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463510 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463513 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463522 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463527 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463531 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.463597 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463535 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463539 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463544 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463548 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463552 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463556 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463560 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463565 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463569 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463573 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463581 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463585 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463589 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463594 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463600 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463604 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463609 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463614 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463618 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463623 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.464417 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463627 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463631 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463636 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463645 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463650 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463654 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463658 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463663 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463667 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463673 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463679 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463683 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463688 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463693 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463702 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463739 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463769 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463776 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463784 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.465270 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463789 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463794 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463800 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463805 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463810 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463814 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463819 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463824 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463834 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463839 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463844 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463848 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463852 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463857 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463862 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463866 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463871 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463875 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463880 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463884 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.465743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463888 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463898 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463902 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463912 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463916 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463921 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463926 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463930 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463935 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463941 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463947 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463951 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463960 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463965 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463971 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463978 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463983 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.463988 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465762 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465774 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.466242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465777 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465780 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465783 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465786 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465789 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465791 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465796 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465800 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465803 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465806 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465810 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465814 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465817 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465820 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465823 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465826 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465828 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465831 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465834 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.466761 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465836 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465839 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465841 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465844 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465846 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465849 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465851 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465854 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465856 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465859 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465861 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465864 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465868 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465871 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465873 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465876 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465879 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465882 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465884 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465887 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.467242 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465889 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465892 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465894 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465897 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465899 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465901 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465904 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465906 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465909 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465912 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465915 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465917 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465920 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465922 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465924 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465927 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465929 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465932 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465934 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465937 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.467759 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465939 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465942 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465945 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465947 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465950 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465953 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465956 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465958 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465961 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465963 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465966 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465969 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465971 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465974 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465978 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465984 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465987 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465989 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.468256 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465992 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465994 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465997 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.465999 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466003 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466005 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466007 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466010 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466013 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466016 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466018 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466020 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466023 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466025 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466039 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466042 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466044 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466048 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466051 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.468726 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466441 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466445 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466448 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466451 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466453 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466457 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466460 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466463 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466465 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466468 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466471 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466473 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466476 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466479 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466481 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466484 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466487 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466490 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466493 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466495 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.469184 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466498 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466502 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466506 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466509 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466513 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466515 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466518 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466521 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466523 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466526 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466529 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466532 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466534 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466537 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466540 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466542 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466545 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466548 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466551 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.469659 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466553 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466556 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466558 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466561 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466563 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466566 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466568 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466571 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466574 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466578 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466582 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466585 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466587 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466590 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466593 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466597 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466599 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466602 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466605 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.470123 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466607 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466610 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466612 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466615 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466618 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466620 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466623 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466625 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466628 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466630 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466633 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466635 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466637 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466640 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466642 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466645 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466648 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466650 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466653 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.470603 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466657 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466660 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466663 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466666 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466668 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466672 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466675 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466677 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466679 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466682 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466685 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466688 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466691 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466693 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466695 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466698 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466701 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466704 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466706 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466709 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.471038 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466711 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.466713 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466788 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466823 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466829 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466834 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466838 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466841 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466845 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466849 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466852 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466855 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466859 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466862 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466865 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466868 2581 flags.go:64] FLAG: --cgroup-root="" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466871 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466874 2581 flags.go:64] FLAG: --client-ca-file="" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466877 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466880 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466884 2581 flags.go:64] FLAG: --cluster-domain="" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466888 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466891 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466894 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 02:20:49.471529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466898 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466902 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466905 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466908 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466911 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466914 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466917 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466920 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466924 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466927 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466931 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466934 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466937 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466940 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466943 2581 flags.go:64] FLAG: --enable-server="true" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466945 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466950 2581 flags.go:64] FLAG: --event-burst="100" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466953 2581 flags.go:64] FLAG: --event-qps="50" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466956 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466959 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466962 2581 flags.go:64] FLAG: --eviction-hard="" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466965 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466968 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466971 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466975 2581 flags.go:64] FLAG: --eviction-soft="" Sep 08 02:20:49.472106 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466977 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466980 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466984 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466986 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466990 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466993 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.466996 2581 flags.go:64] FLAG: --feature-gates="" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467000 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467003 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467006 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467009 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467012 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467015 2581 flags.go:64] FLAG: --help="false" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467017 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467021 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467023 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467026 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467029 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467033 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467036 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467038 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467041 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467044 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 02:20:49.472718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467047 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467050 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467053 2581 flags.go:64] FLAG: --kube-reserved="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467056 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467059 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467062 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467064 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467067 2581 flags.go:64] FLAG: --lock-file="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467070 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467073 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467076 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467081 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467084 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467087 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467090 2581 flags.go:64] FLAG: --logging-format="text" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467093 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467096 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467101 2581 flags.go:64] FLAG: --manifest-url="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467104 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467109 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467112 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467116 2581 flags.go:64] FLAG: --max-pods="110" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467118 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467121 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467124 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 02:20:49.473350 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467127 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467130 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467133 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467150 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467157 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467160 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467162 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467165 2581 flags.go:64] FLAG: --pod-cidr="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467169 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467174 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467177 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467180 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467183 2581 flags.go:64] FLAG: --port="10250" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467186 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467189 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064021afc64bbcd9b" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467192 2581 flags.go:64] FLAG: --qos-reserved="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467195 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467198 2581 flags.go:64] FLAG: --register-node="true" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467201 2581 flags.go:64] FLAG: --register-with-taints="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467211 2581 flags.go:64] FLAG: --registry-burst="10" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467214 2581 flags.go:64] FLAG: --registry-qps="5" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467217 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467220 2581 flags.go:64] FLAG: --reserved-memory="" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467223 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467226 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 02:20:49.473992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467230 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467233 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467236 2581 flags.go:64] FLAG: --runonce="false" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467239 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467242 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467245 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467248 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467252 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467255 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467258 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467261 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467264 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467267 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467269 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467272 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467275 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467278 2581 flags.go:64] FLAG: --system-cgroups="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467281 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467286 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467289 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467292 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467296 2581 flags.go:64] FLAG: --tls-min-version="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467299 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467301 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467304 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 02:20:49.474630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467307 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467311 2581 flags.go:64] FLAG: --v="2" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467315 2581 flags.go:64] FLAG: --version="false" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467320 2581 flags.go:64] FLAG: --vmodule="" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467326 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467329 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467459 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467465 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467468 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467471 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467474 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467477 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467480 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467482 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467485 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467487 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467490 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467493 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467495 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467498 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467500 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.475317 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467503 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467507 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467513 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467515 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467518 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467521 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467524 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467527 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467529 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467532 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467535 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467538 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467541 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467544 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467548 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467551 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467553 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467557 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467559 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.475832 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467562 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467565 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467567 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467570 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467572 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467575 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467577 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467580 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467582 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467585 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467588 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467592 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467595 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467598 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467600 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467603 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467606 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467608 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467611 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467613 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.476400 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467616 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467619 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467621 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467624 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467628 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467630 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467633 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467635 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467639 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467641 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467645 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467647 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467650 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467653 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467655 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467658 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467660 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467663 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467665 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467668 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.476935 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467670 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467673 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467675 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467678 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467681 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467683 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467686 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467689 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467691 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467695 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467698 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467702 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467705 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467707 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467710 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467713 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467718 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467721 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467724 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.477427 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467727 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467729 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467732 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467736 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.467739 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.467744 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.475403 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.475417 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.475436 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.475442 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475495 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475500 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475504 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475506 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475509 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.477887 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475512 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475516 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475518 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475523 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475526 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475529 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475532 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475535 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475537 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475540 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475543 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475546 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475548 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475551 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475553 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475556 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475558 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475561 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475563 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.478327 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475566 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475569 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475571 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475574 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475576 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475581 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475584 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475587 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475589 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475593 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475597 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475600 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475603 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475606 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475609 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475611 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475614 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475617 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475620 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.478784 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475623 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475628 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475631 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475634 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475636 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475639 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475641 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475644 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475647 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475649 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475652 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475655 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475657 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475660 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475662 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475665 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475667 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475670 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475673 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.479316 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475676 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475678 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475681 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475683 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475686 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475688 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475691 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475693 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475695 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475698 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475700 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475703 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475706 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475708 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475711 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475713 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475716 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475718 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475721 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475723 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.479788 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475725 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475728 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475731 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475733 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475736 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475738 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475741 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475745 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475748 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475751 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475754 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475757 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475761 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475763 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475766 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.480408 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475769 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.475774 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475930 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475935 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475939 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475942 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475944 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475947 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475950 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475954 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475958 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475961 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475964 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475967 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 02:20:49.480773 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475971 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475974 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475977 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475980 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475982 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475985 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475988 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475991 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475993 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475996 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.475999 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476001 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476004 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476007 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476009 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476012 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476015 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476018 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476021 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476023 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 02:20:49.481177 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476026 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476028 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476031 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476033 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476036 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476038 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476041 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476044 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476046 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476049 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476052 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476054 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476057 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476059 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476062 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476064 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476067 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476070 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476072 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476075 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 02:20:49.481666 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476078 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476080 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476083 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476085 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476088 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476091 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476094 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476096 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476099 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476102 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476105 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476107 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476110 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476113 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476115 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476118 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476120 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476123 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476125 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476128 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 02:20:49.482333 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476130 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476133 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476152 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476155 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476157 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476160 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476163 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476166 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476168 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476171 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476173 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476176 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476179 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476181 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476183 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476186 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476189 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476191 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476194 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476196 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 02:20:49.482816 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476199 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476201 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476206 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476209 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476212 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476214 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:49.476217 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.476222 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.476318 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.478685 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.479795 2581 server.go:1019] "Starting client certificate rotation" Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.479908 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.479955 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 02:20:49.483513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.483432 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 02:20:49.484914 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.484896 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 02:20:49.497419 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.497396 2581 log.go:25] "Validated CRI v1 runtime API" Sep 08 02:20:49.502490 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.502472 2581 log.go:25] "Validated CRI v1 image API" Sep 08 02:20:49.504176 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.504159 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 02:20:49.508212 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.508193 2581 fs.go:135] Filesystem UUIDs: map[171c538e-f374-48b0-9cee-1a0a1acd196d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e161535d-55bd-4171-bed9-6e36c8a1b4e3:/dev/nvme0n1p4] Sep 08 02:20:49.508270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.508211 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 02:20:49.512438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.512331 2581 manager.go:216] Machine: {Timestamp:2026-09-08 02:20:49.511846139 +0000 UTC m=+0.376053240 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099262 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262f2ac5eba6930ad7dab4dea6d990 SystemUUID:ec262f2a-c5eb-a693-0ad7-dab4dea6d990 BootID:e985b809-0454-4275-a936-86ec0b2bd31f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:59:68:c3:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:59:68:c3:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:2d:e2:d5:e9:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 02:20:49.512438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.512430 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 02:20:49.512594 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.512506 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 02:20:49.512717 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.512699 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 02:20:49.516063 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.516037 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 02:20:49.516220 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.516064 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 02:20:49.517581 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.517571 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 02:20:49.517616 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.517583 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 02:20:49.517616 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.517591 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 02:20:49.518555 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.518544 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 02:20:49.519800 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.519791 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 02:20:49.525948 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.525936 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 08 02:20:49.526084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526074 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 02:20:49.526126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526103 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 08 02:20:49.526126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526114 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 02:20:49.526219 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526127 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 02:20:49.526219 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526147 2581 kubelet.go:398] "Adding apiserver pod source" Sep 08 02:20:49.526219 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526156 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 02:20:49.526502 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526490 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 02:20:49.526538 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.526512 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 02:20:49.528910 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.528893 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 02:20:49.531944 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.531927 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 02:20:49.532032 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.531957 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 02:20:49.533418 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533406 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 02:20:49.533418 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533421 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533428 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533433 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533442 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533448 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533462 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533467 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533474 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533480 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533489 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 02:20:49.533511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.533495 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 02:20:49.534423 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.534412 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 02:20:49.534423 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.534423 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 02:20:49.536823 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.536802 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 02:20:49.536906 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.536818 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 02:20:49.537044 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.537027 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 02:20:49.538228 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.538211 2581 server.go:1268] "Started kubelet" Sep 08 02:20:49.538333 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.538275 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 02:20:49.538398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.538339 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 02:20:49.538544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.538531 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 02:20:49.538945 ip-10-0-142-110 systemd[1]: Started Kubernetes Kubelet. Sep 08 02:20:49.542787 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.541607 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 02:20:49.542787 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.542562 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 08 02:20:49.545068 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.545045 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 02:20:49.548497 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.548484 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 02:20:49.548792 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.547625 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371724d8cdda default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.538182618 +0000 UTC m=+0.402389720,LastTimestamp:2026-09-08 02:20:49.538182618 +0000 UTC m=+0.402389720,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.549096 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.549080 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 02:20:49.549237 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.549216 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:49.549920 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.549903 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 02:20:49.549920 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.549922 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 02:20:49.550055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.549904 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 02:20:49.550055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.549975 2581 factory.go:55] Registering systemd factory Sep 08 02:20:49.550055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550021 2581 factory.go:223] Registration of the systemd container factory successfully Sep 08 02:20:49.550055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550048 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 08 02:20:49.550055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550056 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 08 02:20:49.550258 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550251 2581 factory.go:153] Registering CRI-O factory Sep 08 02:20:49.550307 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550265 2581 factory.go:223] Registration of the crio container factory successfully Sep 08 02:20:49.550352 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550315 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 02:20:49.550352 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550334 2581 factory.go:103] Registering Raw factory Sep 08 02:20:49.550352 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.550348 2581 manager.go:1196] Started watching for new ooms in manager Sep 08 02:20:49.551587 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.551572 2581 manager.go:349] Starting recovery of all containers Sep 08 02:20:49.556555 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.556496 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 02:20:49.556555 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.556538 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 02:20:49.562109 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.562093 2581 manager.go:354] Recovery completed Sep 08 02:20:49.564963 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.564816 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 08 02:20:49.566592 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.566574 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpctp" Sep 08 02:20:49.568335 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.568324 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.570089 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570067 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.570168 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570093 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.570168 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570103 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.570686 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570672 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 02:20:49.570686 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570685 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 02:20:49.570808 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570704 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 08 02:20:49.570808 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.570686 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.571544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.571528 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.571622 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.571557 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.571622 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.571573 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.571690 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.571580 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bf8512 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570080018 +0000 UTC m=+0.434287121,LastTimestamp:2026-09-08 02:20:49.570080018 +0000 UTC m=+0.434287121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.572751 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.572736 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpctp" Sep 08 02:20:49.574162 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.574146 2581 policy_none.go:49] "None policy: Start" Sep 08 02:20:49.574259 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.574165 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 02:20:49.574259 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.574180 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 02:20:49.583003 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.582915 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bfc8ae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570097326 +0000 UTC m=+0.434304427,LastTimestamp:2026-09-08 02:20:49.570097326 +0000 UTC m=+0.434304427,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.595709 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.595646 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bfed93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570106771 +0000 UTC m=+0.434313873,LastTimestamp:2026-09-08 02:20:49.570106771 +0000 UTC m=+0.434313873,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.605799 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.605738 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-110.ec2.internal.18d3371726bf8512\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bf8512 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570080018 +0000 UTC m=+0.434287121,LastTimestamp:2026-09-08 02:20:49.571545197 +0000 UTC m=+0.435752303,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.615789 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-110.ec2.internal.18d3371726bfc8ae\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bfc8ae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570097326 +0000 UTC m=+0.434304427,LastTimestamp:2026-09-08 02:20:49.571564464 +0000 UTC m=+0.435771570,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.625299 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-110.ec2.internal.18d3371726bfed93\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d3371726bfed93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-08 02:20:49.570106771 +0000 UTC m=+0.434313873,LastTimestamp:2026-09-08 02:20:49.571578345 +0000 UTC m=+0.435785451,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.649429 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.656982 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.658236 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.658284 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.658311 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.658468 2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.666522 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Sep 08 02:20:49.716809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.715746 2581 policy_none.go:47] "Start" Sep 08 02:20:49.744635 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.744618 2581 manager.go:337] "Starting Device Plugin manager" Sep 08 02:20:49.744717 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.744660 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 02:20:49.744717 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.744675 2581 server.go:87] "Starting device plugin registration server" Sep 08 02:20:49.744984 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.744971 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 02:20:49.745055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.745026 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 02:20:49.745177 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.745159 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 02:20:49.745263 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.745252 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 02:20:49.745303 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.745264 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 02:20:49.746282 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.746265 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 02:20:49.746352 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.746307 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:49.758965 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.758945 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"] Sep 08 02:20:49.759025 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.759006 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.759832 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.759803 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.759902 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.759836 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.759902 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.759846 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.762282 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.762270 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.762424 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.762412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.762480 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.762436 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.762556 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.762541 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.763050 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763034 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.763122 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763064 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.763122 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763074 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.763122 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763035 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.763240 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763157 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.763240 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.763172 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.765423 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.765407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.765498 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.765435 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.766131 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.766115 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.766209 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.766164 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.766209 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.766181 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.786821 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.786801 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.790770 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.790754 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.845445 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.845426 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 02:20:49.846293 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.846277 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 08 02:20:49.846406 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.846311 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 02:20:49.846406 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.846325 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 08 02:20:49.846406 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.846356 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.850762 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.850742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.850835 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.850774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.850835 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.850801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f655c0765fbd80af788f254065029567-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"f655c0765fbd80af788f254065029567\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.855095 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.855083 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.855186 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.855100 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-110.ec2.internal\": node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:49.870980 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.870962 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:49.951330 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.951489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.951489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f655c0765fbd80af788f254065029567-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"f655c0765fbd80af788f254065029567\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.951489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.951489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951426 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f655c0765fbd80af788f254065029567-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"f655c0765fbd80af788f254065029567\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.951489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:49.951453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fee1944cf1a7050fd42886e5aac1766-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"0fee1944cf1a7050fd42886e5aac1766\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:49.971413 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:49.971367 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.072180 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:50.072126 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.089296 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.089273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:50.094215 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.094200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:50.173275 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:50.173239 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.273889 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:50.273809 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.375693 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:50.375660 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.475850 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:50.475813 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 08 02:20:50.479198 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.479170 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 02:20:50.547331 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.547255 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:20:50.548878 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.548862 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 02:20:50.549354 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.549334 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 08 02:20:50.562267 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.562242 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 02:20:50.563427 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.563412 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:20:50.569225 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.569200 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 02:20:50.570633 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.570620 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 08 02:20:50.583009 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.582990 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 02:20:50.591430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.591409 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws68m" Sep 08 02:20:50.598603 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.598584 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws68m" Sep 08 02:20:50.718058 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.718011 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 02:15:49 +0000 UTC" deadline="2028-06-02 20:35:45.598939862 +0000 UTC" Sep 08 02:20:50.718058 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.718052 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15210h14m54.880891843s" Sep 08 02:20:50.791036 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.791004 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:20:50.807013 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:50.806979 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf655c0765fbd80af788f254065029567.slice/crio-81d58b1cf722c46d55f4c260549e6d56f6e47864216ac783b8c652436db1335a WatchSource:0}: Error finding container 81d58b1cf722c46d55f4c260549e6d56f6e47864216ac783b8c652436db1335a: Status 404 returned error can't find the container with id 81d58b1cf722c46d55f4c260549e6d56f6e47864216ac783b8c652436db1335a Sep 08 02:20:50.812279 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:50.812260 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 02:20:50.818796 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:50.818768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fee1944cf1a7050fd42886e5aac1766.slice/crio-98e77caf5794d3bb7605a9b61ab83ad2eddc07e88eb3310b74f31822024d972d WatchSource:0}: Error finding container 98e77caf5794d3bb7605a9b61ab83ad2eddc07e88eb3310b74f31822024d972d: Status 404 returned error can't find the container with id 98e77caf5794d3bb7605a9b61ab83ad2eddc07e88eb3310b74f31822024d972d Sep 08 02:20:51.171821 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.171733 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 02:20:51.527693 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.527610 2581 apiserver.go:52] "Watching apiserver" Sep 08 02:20:51.537714 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.537681 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 02:20:51.538163 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.538135 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8fdjx","kube-system/konnectivity-agent-tpxcx","kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal","openshift-multus/multus-additional-cni-plugins-tzlzv","openshift-network-diagnostics/network-check-target-hxvjp","openshift-network-operator/iptables-alerter-z5md6","openshift-ovn-kubernetes/ovnkube-node-n7gdb","kube-system/global-pull-secret-syncer-49fq7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn","openshift-cluster-node-tuning-operator/tuned-whplq","openshift-dns/node-resolver-fpdgq","openshift-image-registry/node-ca-jltf6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","openshift-multus/multus-tfrlr"] Sep 08 02:20:51.541318 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.540923 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.541318 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.541007 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:20:51.543236 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.543204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.546978 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.546088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.548251 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.547137 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vxcqb\"" Sep 08 02:20:51.548251 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.547318 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 02:20:51.548251 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.547343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 02:20:51.548495 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.548308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:51.548495 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.548376 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:20:51.549019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.548723 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.549019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.548813 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mp2nc\"" Sep 08 02:20:51.549252 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.549230 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 02:20:51.549933 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.549438 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 02:20:51.549933 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.549595 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.549933 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.549747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 02:20:51.551233 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.551212 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.555217 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.555182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.556604 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7m6m\"" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.556896 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.557054 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.557290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.557497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.557584 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.557559 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:20:51.558053 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.558013 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 02:20:51.558388 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.558367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.560114 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.560092 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 02:20:51.561166 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.560647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.561845 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.561589 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gzt98\"" Sep 08 02:20:51.561845 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.561818 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 02:20:51.562291 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.562291 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.562291 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-etc-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-bin\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-netd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-systemd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71bcacec-4773-492a-a0f9-137876f52a73-konnectivity-ca\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-config\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-script-lib\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbsfw\" (UniqueName: \"kubernetes.io/projected/ab21198a-a79c-425b-b1b8-11129df076f9-kube-api-access-wbsfw\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-system-cni-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-systemd-units\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb6g7\" (UniqueName: \"kubernetes.io/projected/c8918d5d-06ef-4cff-a969-69c0ab24e516-kube-api-access-sb6g7\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.562844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-log-socket\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.563407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-slash\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.563407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.563407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71bcacec-4773-492a-a0f9-137876f52a73-agent-certs\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.563407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cnibin\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.563407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.562973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.563708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.563656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.563840 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.563810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-kube-api-access-cjchq\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.564326 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.563934 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 02:20:51.564326 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.564249 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.563852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-host-slash\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.565072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.565584 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.566235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.566836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-netns\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-ovn\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-node-log\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-iptables-alerter-script\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4mk\" (UniqueName: \"kubernetes.io/projected/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-kube-api-access-qk4mk\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-kubelet\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-var-lib-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-env-overrides\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.567916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovn-node-metrics-cert\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.568563 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.568307 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.569393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.569170 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jnfzt\"" Sep 08 02:20:51.570482 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.570378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.573398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.571431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.573398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.571464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ss6rk\"" Sep 08 02:20:51.573398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.571730 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.573685 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.573669 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.573755 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.573683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.574438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.574414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l2g59\"" Sep 08 02:20:51.575827 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.575806 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 02:20:51.575924 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.575846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4w24l\"" Sep 08 02:20:51.575924 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.575899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 02:20:51.576033 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.575846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cffq9\"" Sep 08 02:20:51.576124 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.576107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 02:20:51.576183 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.576154 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 02:20:51.603289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.601592 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 02:15:50 +0000 UTC" deadline="2028-05-21 01:13:57.617295988 +0000 UTC" Sep 08 02:20:51.603289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.601640 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14902h53m6.015659886s" Sep 08 02:20:51.650796 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.650770 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 02:20:51.664761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.664699 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"f655c0765fbd80af788f254065029567","Type":"ContainerStarted","Data":"81d58b1cf722c46d55f4c260549e6d56f6e47864216ac783b8c652436db1335a"} Sep 08 02:20:51.665972 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.665947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"0fee1944cf1a7050fd42886e5aac1766","Type":"ContainerStarted","Data":"98e77caf5794d3bb7605a9b61ab83ad2eddc07e88eb3310b74f31822024d972d"} Sep 08 02:20:51.668436 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-netd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.668436 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-cni-binary-copy\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.668598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-lib-modules\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.668598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbsfw\" (UniqueName: \"kubernetes.io/projected/ab21198a-a79c-425b-b1b8-11129df076f9-kube-api-access-wbsfw\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.668598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.668598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-kubelet-config\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.668598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-dbus\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-serviceca\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-multus-daemon-config\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-etc-kubernetes\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-system-cni-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4pmr\" (UniqueName: \"kubernetes.io/projected/9a812320-5115-405a-8320-a1444fad6f51-kube-api-access-p4pmr\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.668843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysconfig\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-log-socket\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-kubernetes\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-kubelet\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-tmp-dir\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.668977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-sys\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71bcacec-4773-492a-a0f9-137876f52a73-agent-certs\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cnibin\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-host-slash\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-var-lib-kubelet\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-socket-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-host\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-bin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-hostroot\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.669270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-iptables-alerter-script\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-kubelet\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-env-overrides\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-registration-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-hosts-file\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-etc-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-config\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-script-lib\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-modprobe-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-conf\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-systemd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71bcacec-4773-492a-a0f9-137876f52a73-konnectivity-ca\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nxl\" (UniqueName: \"kubernetes.io/projected/a474637a-e633-4ebc-b7c3-10e6ec31701b-kube-api-access-t7nxl\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-system-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-cnibin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-netns\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-systemd-units\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb6g7\" (UniqueName: \"kubernetes.io/projected/c8918d5d-06ef-4cff-a969-69c0ab24e516-kube-api-access-sb6g7\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-host\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.669928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-socket-dir-parent\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6fpk\" (UniqueName: \"kubernetes.io/projected/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-kube-api-access-f6fpk\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-multus\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-device-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-run\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-slash\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-kube-api-access-cjchq\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-tuned\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-k8s-cni-cncf-io\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.670782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-netns\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-ovn\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-node-log\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-systemd\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-multus-certs\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbts\" (UniqueName: \"kubernetes.io/projected/142d8159-3245-491f-aa1b-380459fc9813-kube-api-access-vcbts\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4mk\" (UniqueName: \"kubernetes.io/projected/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-kube-api-access-qk4mk\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-var-lib-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovn-node-metrics-cert\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-sys-fs\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-tmp\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-conf-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzwp\" (UniqueName: \"kubernetes.io/projected/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-kube-api-access-5zzwp\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-bin\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.671556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-bin\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.670996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-cni-netd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.671854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.671854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-script-lib\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.671898 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.671972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-systemd\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672113 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.672082 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:51.672386 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.672152 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:20:52.172128701 +0000 UTC m=+3.036335808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:51.672386 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.672386 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-systemd-units\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672553 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-ovn\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672553 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71bcacec-4773-492a-a0f9-137876f52a73-konnectivity-ca\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.672658 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-node-log\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672658 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-slash\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672673 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cnibin\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.672761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672696 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 02:20:51.672864 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-host-slash\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.672864 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.672864 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-var-lib-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.673023 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.672865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-system-cni-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.673173 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-env-overrides\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.673173 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.673173 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-kubelet\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.673173 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-log-socket\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.673511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673322 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-iptables-alerter-script\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.673712 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.673653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-etc-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.674143 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.674119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.674304 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.674281 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-run-openvswitch\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.674364 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.674338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8918d5d-06ef-4cff-a969-69c0ab24e516-host-run-netns\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.674608 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.674587 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovnkube-config\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.677735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.677710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8918d5d-06ef-4cff-a969-69c0ab24e516-ovn-node-metrics-cert\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.677912 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.677890 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71bcacec-4773-492a-a0f9-137876f52a73-agent-certs\") pod \"konnectivity-agent-tpxcx\" (UID: \"71bcacec-4773-492a-a0f9-137876f52a73\") " pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.680243 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.680216 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:20:51.680319 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.680262 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:20:51.680319 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.680278 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:51.683264 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.682473 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:20:52.182447828 +0000 UTC m=+3.046654935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:51.690274 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.688358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjchq\" (UniqueName: \"kubernetes.io/projected/dc5c85d6-40b3-419e-b4c2-e48b4ef86626-kube-api-access-cjchq\") pod \"multus-additional-cni-plugins-tzlzv\" (UID: \"dc5c85d6-40b3-419e-b4c2-e48b4ef86626\") " pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.692385 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.691306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb6g7\" (UniqueName: \"kubernetes.io/projected/c8918d5d-06ef-4cff-a969-69c0ab24e516-kube-api-access-sb6g7\") pod \"ovnkube-node-n7gdb\" (UID: \"c8918d5d-06ef-4cff-a969-69c0ab24e516\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.692385 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.691778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbsfw\" (UniqueName: \"kubernetes.io/projected/ab21198a-a79c-425b-b1b8-11129df076f9-kube-api-access-wbsfw\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:51.694958 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.694935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4mk\" (UniqueName: \"kubernetes.io/projected/dbb5f77f-b3ef-4011-9a07-e0afc6299da6-kube-api-access-qk4mk\") pod \"iptables-alerter-z5md6\" (UID: \"dbb5f77f-b3ef-4011-9a07-e0afc6299da6\") " pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.772028 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.771990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-systemd\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-multus-certs\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbts\" (UniqueName: \"kubernetes.io/projected/142d8159-3245-491f-aa1b-380459fc9813-kube-api-access-vcbts\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-sys-fs\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-tmp\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-conf-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-multus-certs\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzwp\" (UniqueName: \"kubernetes.io/projected/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-kube-api-access-5zzwp\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-cni-binary-copy\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-lib-modules\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-kubelet-config\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-dbus\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-serviceca\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-multus-daemon-config\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-etc-kubernetes\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4pmr\" (UniqueName: \"kubernetes.io/projected/9a812320-5115-405a-8320-a1444fad6f51-kube-api-access-p4pmr\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysconfig\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-conf-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-kubernetes\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-sys-fs\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-kubelet\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-dbus\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-kubelet\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-tmp-dir\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772614 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-systemd\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.772795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-sys\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-var-lib-kubelet\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-socket-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-host\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-bin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-hostroot\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-registration-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-hosts-file\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772918 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-tmp-dir\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-modprobe-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-conf\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nxl\" (UniqueName: \"kubernetes.io/projected/a474637a-e633-4ebc-b7c3-10e6ec31701b-kube-api-access-t7nxl\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.772995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-sys\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-system-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.773025 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-hostroot\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-cnibin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.773703 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-system-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:51.773080 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:20:52.273062342 +0000 UTC m=+3.137269437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-var-lib-kubelet\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-cnibin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-registration-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-cni-binary-copy\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-cni-dir\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-hosts-file\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-lib-modules\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-host\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-bin\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-socket-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-modprobe-d\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysctl-conf\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-kubelet-config\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773439 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-kubernetes\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.774792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-sysconfig\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773542 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-serviceca\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-netns\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-host\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-etc-kubernetes\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-socket-dir-parent\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6fpk\" (UniqueName: \"kubernetes.io/projected/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-kube-api-access-f6fpk\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-multus\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-multus-socket-dir-parent\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-netns\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-host\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-device-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-run\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-device-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773836 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-var-lib-cni-multus\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a812320-5115-405a-8320-a1444fad6f51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-tuned\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.775666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-k8s-cni-cncf-io\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.776583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a474637a-e633-4ebc-b7c3-10e6ec31701b-run\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.776583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.773972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/142d8159-3245-491f-aa1b-380459fc9813-host-run-k8s-cni-cncf-io\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.776583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.774361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/142d8159-3245-491f-aa1b-380459fc9813-multus-daemon-config\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.776583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.775104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-tmp\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.776583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.776435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a474637a-e633-4ebc-b7c3-10e6ec31701b-etc-tuned\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.786138 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.786067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzwp\" (UniqueName: \"kubernetes.io/projected/7824f8c1-1a41-4479-8ff8-2e9b29bdb559-kube-api-access-5zzwp\") pod \"node-resolver-fpdgq\" (UID: \"7824f8c1-1a41-4479-8ff8-2e9b29bdb559\") " pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.786531 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.786509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nxl\" (UniqueName: \"kubernetes.io/projected/a474637a-e633-4ebc-b7c3-10e6ec31701b-kube-api-access-t7nxl\") pod \"tuned-whplq\" (UID: \"a474637a-e633-4ebc-b7c3-10e6ec31701b\") " pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.787269 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.786976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6fpk\" (UniqueName: \"kubernetes.io/projected/521996c4-d0ba-41fc-bd0e-ebc8b04ff01c-kube-api-access-f6fpk\") pod \"node-ca-jltf6\" (UID: \"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c\") " pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.787269 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.787226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbts\" (UniqueName: \"kubernetes.io/projected/142d8159-3245-491f-aa1b-380459fc9813-kube-api-access-vcbts\") pod \"multus-tfrlr\" (UID: \"142d8159-3245-491f-aa1b-380459fc9813\") " pod="openshift-multus/multus-tfrlr" Sep 08 02:20:51.787837 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.787807 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4pmr\" (UniqueName: \"kubernetes.io/projected/9a812320-5115-405a-8320-a1444fad6f51-kube-api-access-p4pmr\") pod \"aws-ebs-csi-driver-node-ndsvn\" (UID: \"9a812320-5115-405a-8320-a1444fad6f51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.860147 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.860067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:20:51.875152 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.875112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" Sep 08 02:20:51.875475 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:51.875429 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bcacec_4773_492a_a0f9_137876f52a73.slice/crio-ee64bc44591967b955ca49d30aeb91641ce33e895e7f816f978c3249e7e23bec WatchSource:0}: Error finding container ee64bc44591967b955ca49d30aeb91641ce33e895e7f816f978c3249e7e23bec: Status 404 returned error can't find the container with id ee64bc44591967b955ca49d30aeb91641ce33e895e7f816f978c3249e7e23bec Sep 08 02:20:51.884605 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:51.884577 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5c85d6_40b3_419e_b4c2_e48b4ef86626.slice/crio-210db55c58bd38f34cfd0cfc730081e77b9eab0cbd5bf656232ec3351704ef1f WatchSource:0}: Error finding container 210db55c58bd38f34cfd0cfc730081e77b9eab0cbd5bf656232ec3351704ef1f: Status 404 returned error can't find the container with id 210db55c58bd38f34cfd0cfc730081e77b9eab0cbd5bf656232ec3351704ef1f Sep 08 02:20:51.888200 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.888176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5md6" Sep 08 02:20:51.894499 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.894475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:20:51.904581 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.904557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" Sep 08 02:20:51.913438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.913411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whplq" Sep 08 02:20:51.922397 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.922371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fpdgq" Sep 08 02:20:51.930291 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.930260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jltf6" Sep 08 02:20:51.938396 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:51.938369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfrlr" Sep 08 02:20:52.177685 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.177643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:52.177871 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.177814 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:52.177918 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.177905 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:20:53.177881333 +0000 UTC m=+4.042088445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:52.278520 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.278480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:52.278668 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.278544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:52.278723 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278670 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:52.278758 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278750 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:20:53.278728889 +0000 UTC m=+4.142935984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:52.278814 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278678 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:20:52.278814 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278785 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:20:52.278814 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278799 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:52.278926 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:52.278852 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:20:53.278836944 +0000 UTC m=+4.143044041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:52.602462 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.602402 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 02:15:50 +0000 UTC" deadline="2028-02-24 08:13:15.474229672 +0000 UTC" Sep 08 02:20:52.602462 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.602455 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12821h52m22.87177709s" Sep 08 02:20:52.668705 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.668667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerStarted","Data":"210db55c58bd38f34cfd0cfc730081e77b9eab0cbd5bf656232ec3351704ef1f"} Sep 08 02:20:52.669809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:52.669780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpxcx" event={"ID":"71bcacec-4773-492a-a0f9-137876f52a73","Type":"ContainerStarted","Data":"ee64bc44591967b955ca49d30aeb91641ce33e895e7f816f978c3249e7e23bec"} Sep 08 02:20:53.029752 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.029720 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142d8159_3245_491f_aa1b_380459fc9813.slice/crio-5dd7ff7ac6916551c9cd88051715e477a57c8defaa68c90a7ef7a996b77377e5 WatchSource:0}: Error finding container 5dd7ff7ac6916551c9cd88051715e477a57c8defaa68c90a7ef7a996b77377e5: Status 404 returned error can't find the container with id 5dd7ff7ac6916551c9cd88051715e477a57c8defaa68c90a7ef7a996b77377e5 Sep 08 02:20:53.035898 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.035859 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8918d5d_06ef_4cff_a969_69c0ab24e516.slice/crio-d9ab4bf1039686f674ec1d3d17096a39d82714002be902dda4c8b99740d07354 WatchSource:0}: Error finding container d9ab4bf1039686f674ec1d3d17096a39d82714002be902dda4c8b99740d07354: Status 404 returned error can't find the container with id d9ab4bf1039686f674ec1d3d17096a39d82714002be902dda4c8b99740d07354 Sep 08 02:20:53.041889 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.041514 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521996c4_d0ba_41fc_bd0e_ebc8b04ff01c.slice/crio-e23b146290c6de4e8d42e87d97e8d4c240942bc5571cb97d0270a6501e0b9a99 WatchSource:0}: Error finding container e23b146290c6de4e8d42e87d97e8d4c240942bc5571cb97d0270a6501e0b9a99: Status 404 returned error can't find the container with id e23b146290c6de4e8d42e87d97e8d4c240942bc5571cb97d0270a6501e0b9a99 Sep 08 02:20:53.043442 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.043409 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb5f77f_b3ef_4011_9a07_e0afc6299da6.slice/crio-a771fa4a02f274804b2cf36da78fc1a59abe9a7fc736094b34b0f3c1e7fae141 WatchSource:0}: Error finding container a771fa4a02f274804b2cf36da78fc1a59abe9a7fc736094b34b0f3c1e7fae141: Status 404 returned error can't find the container with id a771fa4a02f274804b2cf36da78fc1a59abe9a7fc736094b34b0f3c1e7fae141 Sep 08 02:20:53.072109 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.072079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7824f8c1_1a41_4479_8ff8_2e9b29bdb559.slice/crio-8af9aba9562722ae9add800b752ed99aeff7f804ad37f8f32779f65b529fc15b WatchSource:0}: Error finding container 8af9aba9562722ae9add800b752ed99aeff7f804ad37f8f32779f65b529fc15b: Status 404 returned error can't find the container with id 8af9aba9562722ae9add800b752ed99aeff7f804ad37f8f32779f65b529fc15b Sep 08 02:20:53.074054 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:20:53.074027 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a812320_5115_405a_8320_a1444fad6f51.slice/crio-4f7ef17c9357d78b11649363a03a28760fd5664b3364643d2493755d5ccff905 WatchSource:0}: Error finding container 4f7ef17c9357d78b11649363a03a28760fd5664b3364643d2493755d5ccff905: Status 404 returned error can't find the container with id 4f7ef17c9357d78b11649363a03a28760fd5664b3364643d2493755d5ccff905 Sep 08 02:20:53.186786 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.186544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:53.186975 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.186833 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:53.186975 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.186917 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:20:55.186895716 +0000 UTC m=+6.051102825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:53.287865 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.287660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:53.287865 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.287736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:53.287865 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287856 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:53.288090 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287872 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:20:53.288090 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287889 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:20:53.288090 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287900 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:53.288090 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287936 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:20:55.287914503 +0000 UTC m=+6.152121616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:53.288090 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.287957 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:20:55.287945647 +0000 UTC m=+6.152152743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.662014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.662156 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.662642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.662762 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.662831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:53.663000 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:53.662910 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:20:53.684072 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.684032 2581 generic.go:356] "Generic (PLEG): container finished" podID="0fee1944cf1a7050fd42886e5aac1766" containerID="eea4da527bd05dc261cb29d681b6657e59d474c5099d15f3e941f776d35e6090" exitCode=0 Sep 08 02:20:53.684386 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.684355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"0fee1944cf1a7050fd42886e5aac1766","Type":"ContainerDied","Data":"eea4da527bd05dc261cb29d681b6657e59d474c5099d15f3e941f776d35e6090"} Sep 08 02:20:53.692681 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.692641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jltf6" event={"ID":"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c","Type":"ContainerStarted","Data":"e23b146290c6de4e8d42e87d97e8d4c240942bc5571cb97d0270a6501e0b9a99"} Sep 08 02:20:53.696175 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.696140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" event={"ID":"9a812320-5115-405a-8320-a1444fad6f51","Type":"ContainerStarted","Data":"4f7ef17c9357d78b11649363a03a28760fd5664b3364643d2493755d5ccff905"} Sep 08 02:20:53.702602 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.702511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whplq" event={"ID":"a474637a-e633-4ebc-b7c3-10e6ec31701b","Type":"ContainerStarted","Data":"8a19c37c067c7ee6980ac897480844d5a68644929532d19c876947ddd0986340"} Sep 08 02:20:53.706147 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.706094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fpdgq" event={"ID":"7824f8c1-1a41-4479-8ff8-2e9b29bdb559","Type":"ContainerStarted","Data":"8af9aba9562722ae9add800b752ed99aeff7f804ad37f8f32779f65b529fc15b"} Sep 08 02:20:53.710928 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.710901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"f655c0765fbd80af788f254065029567","Type":"ContainerStarted","Data":"2f5d425268308c6f36e900af15c072a3a38bfa1072d9fb09c0075777178b3942"} Sep 08 02:20:53.717030 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.717002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5md6" event={"ID":"dbb5f77f-b3ef-4011-9a07-e0afc6299da6","Type":"ContainerStarted","Data":"a771fa4a02f274804b2cf36da78fc1a59abe9a7fc736094b34b0f3c1e7fae141"} Sep 08 02:20:53.723774 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.722363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"d9ab4bf1039686f674ec1d3d17096a39d82714002be902dda4c8b99740d07354"} Sep 08 02:20:53.727836 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.727779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" podStartSLOduration=3.727759409 podStartE2EDuration="3.727759409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:20:53.727563643 +0000 UTC m=+4.591770757" watchObservedRunningTime="2026-09-08 02:20:53.727759409 +0000 UTC m=+4.591966526" Sep 08 02:20:53.734404 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:53.734322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfrlr" event={"ID":"142d8159-3245-491f-aa1b-380459fc9813","Type":"ContainerStarted","Data":"5dd7ff7ac6916551c9cd88051715e477a57c8defaa68c90a7ef7a996b77377e5"} Sep 08 02:20:55.203925 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.203888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:55.204529 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.204041 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:55.204529 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.204101 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:20:59.204084747 +0000 UTC m=+10.068291849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:55.304957 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.304915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:55.305125 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.304995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:55.305555 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.305526 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:20:55.305657 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.305559 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:20:55.305657 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.305574 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:55.305657 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.305645 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:20:59.305626898 +0000 UTC m=+10.169833999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:55.312338 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.312312 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:55.312449 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.312403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:20:59.312383205 +0000 UTC m=+10.176590315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:55.659773 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.659743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:55.659961 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.659879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:20:55.660329 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.660308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:55.660449 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.660426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:20:55.660713 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:55.660590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:55.660713 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:55.660670 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:20:57.659268 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:57.659234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:57.659722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:57.659242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:57.659722 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:57.659502 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:20:57.659722 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:57.659378 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:20:57.659722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:57.659555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:57.659722 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:57.659631 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:20:59.239089 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.239054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:59.239585 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.239243 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:59.239585 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.239321 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:07.239299578 +0000 UTC m=+18.103506691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:20:59.340328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.339674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:59.340328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.339748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:59.340328 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.339885 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:59.340328 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.339941 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:21:07.339921778 +0000 UTC m=+18.204128869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:20:59.340666 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.340365 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:20:59.340666 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.340382 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:20:59.340666 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.340394 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:59.340666 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.340465 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:21:07.340450778 +0000 UTC m=+18.204657867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:20:59.659761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.659727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:20:59.659927 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.659829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:20:59.659927 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.659839 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:20:59.660043 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.659933 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:20:59.660043 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:20:59.659981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:20:59.660158 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:20:59.660062 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:01.659975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:01.659880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:01.660556 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:01.660017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:01.660556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:01.660071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:01.660556 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:01.660194 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:01.660556 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:01.659890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:01.660556 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:01.660302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:03.658949 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:03.658911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:03.659407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:03.658911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:03.659407 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:03.659043 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:03.659407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:03.658926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:03.659407 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:03.659126 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:03.659407 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:03.659221 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:05.658925 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:05.658882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:05.658925 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:05.658916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:05.659448 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:05.658883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:05.659448 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:05.659020 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:05.659448 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:05.659094 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:05.659448 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:05.659200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:07.296364 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.296329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:07.296818 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.296492 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:21:07.296818 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.296560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:23.296542192 +0000 UTC m=+34.160749283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:21:07.396815 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.396787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:07.396990 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.396837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:07.396990 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.396961 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:21:07.396990 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.396970 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:21:07.396990 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.396994 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:21:07.397166 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.397007 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:21:07.397166 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.397012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:21:23.396999844 +0000 UTC m=+34.261206932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:21:07.397166 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.397056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:21:23.397039914 +0000 UTC m=+34.261247023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:21:07.658688 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.658649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:07.658885 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.658642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:07.658885 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:07.658769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:07.658885 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.658767 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:07.659035 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.658879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:07.659035 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:07.658961 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:09.659445 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:09.659408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:09.659860 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:09.659516 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:09.659860 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:09.659596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:09.659860 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:09.659719 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:09.659860 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:09.659790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:09.660039 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:09.659920 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:10.772183 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.771835 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jltf6" event={"ID":"521996c4-d0ba-41fc-bd0e-ebc8b04ff01c","Type":"ContainerStarted","Data":"7a2dfcd648b7e08da0a258edfac48ea510ca52a192dc4caef2cb8c81bb1a52ed"} Sep 08 02:21:10.773430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.773409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" event={"ID":"9a812320-5115-405a-8320-a1444fad6f51","Type":"ContainerStarted","Data":"f2fd59a0935f7430c5c357de8eaa55bca19494ccfaa5aeeb7d12d1ee4f69fcc0"} Sep 08 02:21:10.774826 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.774807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whplq" event={"ID":"a474637a-e633-4ebc-b7c3-10e6ec31701b","Type":"ContainerStarted","Data":"2dec9c8b19fb50c6b1dae603f2dbd9d52f74728bf46d2625e588d355565d3f7c"} Sep 08 02:21:10.776186 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.776154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fpdgq" event={"ID":"7824f8c1-1a41-4479-8ff8-2e9b29bdb559","Type":"ContainerStarted","Data":"9f59ed7eadc568beae13756b796a38ea6acae918b94f22b022c8e84616644d83"} Sep 08 02:21:10.777651 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.777628 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="041effaf46732c28d87f968923e3b30509d95d1b0962acdd8d6b7c0c9b64414e" exitCode=0 Sep 08 02:21:10.777737 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.777700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"041effaf46732c28d87f968923e3b30509d95d1b0962acdd8d6b7c0c9b64414e"} Sep 08 02:21:10.779177 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.779159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpxcx" event={"ID":"71bcacec-4773-492a-a0f9-137876f52a73","Type":"ContainerStarted","Data":"caae4e88a8ee631841586184b3a479c583bcec258c2c21e1419267d93efe51f8"} Sep 08 02:21:10.781795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.781768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"4c948e0309b599e478c06ce6d8b8437dfefd66e94871e4f80aebc68197ef9e75"} Sep 08 02:21:10.781890 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.781820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"eb415c498690466964f841b5d5293dc4a10c4a397242fb1e45e0a3986d7796c4"} Sep 08 02:21:10.781890 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.781861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"e8fb36a7ddacb8aea8951c45a82b488be44e48a10ed6491fea7e443dda5e5cd5"} Sep 08 02:21:10.783266 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.783248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfrlr" event={"ID":"142d8159-3245-491f-aa1b-380459fc9813","Type":"ContainerStarted","Data":"614f587051008562ec7e03d45506e503a76e6d96a614eb06afd840f5b1ec18a1"} Sep 08 02:21:10.785096 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.785075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"0fee1944cf1a7050fd42886e5aac1766","Type":"ContainerStarted","Data":"1af0bf15a994b6d66a0c0c6f597c5d82673f64c05bdf798a0fae0a07a1c12840"} Sep 08 02:21:10.804483 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.804447 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jltf6" podStartSLOduration=3.9443437279999998 podStartE2EDuration="20.804434317s" totalImagesPullingTime="16.860090589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.804036049 +0000 UTC m=+21.668243160" watchObservedRunningTime="2026-09-08 02:21:10.804434317 +0000 UTC m=+21.668641473" Sep 08 02:21:10.847181 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.847123 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-whplq" podStartSLOduration=3.989694837 podStartE2EDuration="20.847106839s" totalImagesPullingTime="16.857412002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.828360906 +0000 UTC m=+21.692568015" watchObservedRunningTime="2026-09-08 02:21:10.847106839 +0000 UTC m=+21.711313952" Sep 08 02:21:10.847353 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.847333 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tfrlr" podStartSLOduration=3.915803163 podStartE2EDuration="20.847325557s" totalImagesPullingTime="16.931522394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.846741303 +0000 UTC m=+21.710948414" watchObservedRunningTime="2026-09-08 02:21:10.847325557 +0000 UTC m=+21.711532679" Sep 08 02:21:10.862975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.862936 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" podStartSLOduration=20.862923441 podStartE2EDuration="20.862923441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.862715184 +0000 UTC m=+21.726922293" watchObservedRunningTime="2026-09-08 02:21:10.862923441 +0000 UTC m=+21.727130551" Sep 08 02:21:10.887401 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.887167 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tpxcx" podStartSLOduration=2.908557417 podStartE2EDuration="20.887129243s" totalImagesPullingTime="17.978571826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.887043943 +0000 UTC m=+21.751251053" watchObservedRunningTime="2026-09-08 02:21:10.887129243 +0000 UTC m=+21.751336353" Sep 08 02:21:10.905598 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:10.905553 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fpdgq" podStartSLOduration=4.05304692 podStartE2EDuration="20.905537129s" totalImagesPullingTime="16.852490209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:10.90530382 +0000 UTC m=+21.769510932" watchObservedRunningTime="2026-09-08 02:21:10.905537129 +0000 UTC m=+21.769744240" Sep 08 02:21:11.440425 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.440381 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 02:21:11.658829 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.658799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:11.659072 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.658841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:11.659072 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.658799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:11.659072 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:11.658916 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:11.659072 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:11.658968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:11.659072 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:11.659037 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:11.757848 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.757717 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T02:21:11.440399Z","UUID":"9cefdcea-aee7-43bf-8950-b03e53c5d979","Handler":null,"Name":"","Endpoint":""} Sep 08 02:21:11.759290 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.759260 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 02:21:11.759290 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.759292 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 02:21:11.790116 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.790093 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" event={"ID":"9a812320-5115-405a-8320-a1444fad6f51","Type":"ContainerStarted","Data":"5fdb33bf2d1c92949073999d562e9f515c9d56a8df8f92116ad63ce2e9a2da6b"} Sep 08 02:21:11.793197 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.792527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5md6" event={"ID":"dbb5f77f-b3ef-4011-9a07-e0afc6299da6","Type":"ContainerStarted","Data":"fe9adf5eb317a14179cc5014f03b1be3f48de738cd512704dac7f5d31950bda5"} Sep 08 02:21:11.797718 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.797685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"cc2fab54a035f0cacd862140594ce201bfbfa956013473f817870dd87b59587d"} Sep 08 02:21:11.797843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.797746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"2282918205a81130f2b9280550f3a4c9baac47b749b78109affea9b6113b027f"} Sep 08 02:21:11.797843 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.797786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"5648115917ca2db840704f464573bdfdb14657e5d1dc5ce8822775e4cf9a8477"} Sep 08 02:21:11.810089 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:11.810046 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z5md6" podStartSLOduration=4.958565532 podStartE2EDuration="21.810029627s" totalImagesPullingTime="16.851464095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:11.809925809 +0000 UTC m=+22.674132919" watchObservedRunningTime="2026-09-08 02:21:11.810029627 +0000 UTC m=+22.674236738" Sep 08 02:21:12.801660 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:12.801580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" event={"ID":"9a812320-5115-405a-8320-a1444fad6f51","Type":"ContainerStarted","Data":"50f72f960e19e73d31e8dd5dbd009e9c7c0fdb8f60b5aeb0bfc42cf2b35077b5"} Sep 08 02:21:12.822110 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:12.822066 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndsvn" podStartSLOduration=3.705131781 podStartE2EDuration="22.822053509s" totalImagesPullingTime="19.116921728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:12.821920764 +0000 UTC m=+23.686127873" watchObservedRunningTime="2026-09-08 02:21:12.822053509 +0000 UTC m=+23.686260620" Sep 08 02:21:13.659593 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:13.659400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:13.659860 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:13.659401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:13.659860 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:13.659686 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:13.659860 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:13.659410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:13.659860 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:13.659728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:13.660072 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:13.659865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:13.807412 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:13.807374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"977ad96e46e85848a6f3aa06b6772fee1166d08af057d0db4a48267632b82b89"} Sep 08 02:21:14.422483 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:14.422445 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:21:14.423220 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:14.423196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:21:14.809615 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:14.809581 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:21:14.810209 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:14.810183 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tpxcx" Sep 08 02:21:15.659219 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:15.659184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:15.659397 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:15.659184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:15.659397 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:15.659318 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:15.659397 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:15.659198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:15.659397 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:15.659384 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:15.659595 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:15.659440 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:16.814800 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:16.814605 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="3833243204d8f440d19f525d67ad1e657046d69ecf0bbec9ccf9214d2a5becd1" exitCode=0 Sep 08 02:21:16.815243 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:16.814686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"3833243204d8f440d19f525d67ad1e657046d69ecf0bbec9ccf9214d2a5becd1"} Sep 08 02:21:16.818958 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:16.818935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" event={"ID":"c8918d5d-06ef-4cff-a969-69c0ab24e516","Type":"ContainerStarted","Data":"dc8f964cf71040e545f9313f61d09e037ac955301746ab4d3abab114659a466d"} Sep 08 02:21:16.869582 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:16.869539 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" podStartSLOduration=9.371275303000001 podStartE2EDuration="26.869525818s" totalImagesPullingTime="17.498250515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:16.868837592 +0000 UTC m=+27.733044711" watchObservedRunningTime="2026-09-08 02:21:16.869525818 +0000 UTC m=+27.733732928" Sep 08 02:21:17.658798 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.658765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:17.659070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.658914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:17.659192 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.659058 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:17.659192 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.659161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:17.659300 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.659239 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:17.659360 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.659303 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:17.823684 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.823658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerStarted","Data":"b5725f73da1ce00c587ea8667585e49227df4c6b079f022811e435f18ed8e7df"} Sep 08 02:21:17.824231 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.824156 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:17.824231 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.824228 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:17.824337 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.824275 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:17.838122 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.838101 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:17.838256 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.838224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:17.904421 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.904385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49fq7"] Sep 08 02:21:17.904554 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.904479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:17.904609 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.904560 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:17.908316 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.908294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxvjp"] Sep 08 02:21:17.908435 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.908362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:17.908490 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.908447 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:17.909288 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.909235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8fdjx"] Sep 08 02:21:17.909370 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:17.909318 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:17.909429 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:17.909412 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:18.826975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:18.826939 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="b5725f73da1ce00c587ea8667585e49227df4c6b079f022811e435f18ed8e7df" exitCode=0 Sep 08 02:21:18.827459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:18.827018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"b5725f73da1ce00c587ea8667585e49227df4c6b079f022811e435f18ed8e7df"} Sep 08 02:21:19.660293 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:19.660268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:19.660378 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:19.660340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:19.660378 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:19.660354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:19.660456 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:19.660435 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:19.660499 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:19.660480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:19.660601 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:19.660583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:19.831688 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:19.831481 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="c7af604ab44028a45e7696aa06edf7c50e3c7f09123529e2c20b676cbd0fe4a4" exitCode=0 Sep 08 02:21:19.832198 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:19.831563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"c7af604ab44028a45e7696aa06edf7c50e3c7f09123529e2c20b676cbd0fe4a4"} Sep 08 02:21:21.658884 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:21.658846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:21.659392 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:21.658846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:21.659392 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:21.658974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:21.659392 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:21.658967 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49fq7" podUID="22fd687d-cbcc-47c4-9269-f3b113bf9bfe" Sep 08 02:21:21.659392 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:21.659076 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fdjx" podUID="ab21198a-a79c-425b-b1b8-11129df076f9" Sep 08 02:21:21.659392 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:21.659173 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxvjp" podUID="f4949389-2f0f-4fb7-992b-20abc8a493dd" Sep 08 02:21:22.889025 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.888953 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeReady" Sep 08 02:21:22.889436 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.889094 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 02:21:22.924772 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.924738 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:21:22.945461 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.945178 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9"] Sep 08 02:21:22.948167 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.945764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:22.948643 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.948619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 02:21:22.949628 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.949172 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 02:21:22.949628 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.949253 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 02:21:22.949628 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.949394 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tr26m\"" Sep 08 02:21:22.965649 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.965619 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc"] Sep 08 02:21:22.965815 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.965791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:22.967660 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.967642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 02:21:22.968567 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.968547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 08 02:21:22.968567 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.968561 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 02:21:22.968722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.968592 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 02:21:22.968722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.968609 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 02:21:22.989384 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.989364 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5"] Sep 08 02:21:22.989480 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.989400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:22.992224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.992205 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 08 02:21:22.992328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.992225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 08 02:21:22.992328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.992305 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 08 02:21:22.992440 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:22.992349 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 08 02:21:23.007309 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.007284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5"] Sep 08 02:21:23.007417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.007319 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:21:23.007417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.007343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9"] Sep 08 02:21:23.007417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.007362 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kmprg"] Sep 08 02:21:23.007417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.007410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.010097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.010078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-26stw\"" Sep 08 02:21:23.010683 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.010348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 08 02:21:23.025514 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.025449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc"] Sep 08 02:21:23.025514 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.025483 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dr8xs"] Sep 08 02:21:23.025669 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.025568 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.028421 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.028401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 02:21:23.028504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.028436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xsgpb\"" Sep 08 02:21:23.028707 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.028688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 02:21:23.029039 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.029019 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 02:21:23.045537 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.045507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmprg"] Sep 08 02:21:23.045630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.045541 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dr8xs"] Sep 08 02:21:23.045630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.045595 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.048181 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.048162 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 02:21:23.048351 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.048333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56wgd\"" Sep 08 02:21:23.048398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.048385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 02:21:23.111069 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtrz\" (UniqueName: \"kubernetes.io/projected/14102720-7b3b-42b7-962d-b59d2231f4bc-kube-api-access-kwtrz\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111234 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111234 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344173d-b945-4345-8a34-a2de4986ae42-cert\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.111234 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111234 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14102720-7b3b-42b7-962d-b59d2231f4bc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8872k\" (UniqueName: \"kubernetes.io/projected/a978e90a-63cc-4020-bcf6-ed652af9c29e-kube-api-access-8872k\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a978e90a-63cc-4020-bcf6-ed652af9c29e-klusterlet-config\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxjh\" (UniqueName: \"kubernetes.io/projected/e18ae241-143b-49f6-9f40-989768a05555-kube-api-access-bmxjh\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r844p\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.111738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a978e90a-63cc-4020-bcf6-ed652af9c29e-tmp\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.112301 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e18ae241-143b-49f6-9f40-989768a05555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.112301 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.112301 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.112301 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.111821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2ks\" (UniqueName: \"kubernetes.io/projected/f344173d-b945-4345-8a34-a2de4986ae42-kube-api-access-pg2ks\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.112301 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.112286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:23.212880 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.212880 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2ks\" (UniqueName: \"kubernetes.io/projected/f344173d-b945-4345-8a34-a2de4986ae42-kube-api-access-pg2ks\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.212880 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc81df56-c592-44b7-b55e-8a7a815dcd94-tmp-dir\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.212880 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtrz\" (UniqueName: \"kubernetes.io/projected/14102720-7b3b-42b7-962d-b59d2231f4bc-kube-api-access-kwtrz\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.212968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344173d-b945-4345-8a34-a2de4986ae42-cert\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14102720-7b3b-42b7-962d-b59d2231f4bc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8872k\" (UniqueName: \"kubernetes.io/projected/a978e90a-63cc-4020-bcf6-ed652af9c29e-kube-api-access-8872k\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a978e90a-63cc-4020-bcf6-ed652af9c29e-klusterlet-config\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxjh\" (UniqueName: \"kubernetes.io/projected/e18ae241-143b-49f6-9f40-989768a05555-kube-api-access-bmxjh\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r844p\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xdm\" (UniqueName: \"kubernetes.io/projected/fc81df56-c592-44b7-b55e-8a7a815dcd94-kube-api-access-c6xdm\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc81df56-c592-44b7-b55e-8a7a815dcd94-config-volume\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a978e90a-63cc-4020-bcf6-ed652af9c29e-tmp\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e18ae241-143b-49f6-9f40-989768a05555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.213679 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.214249 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.213898 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14102720-7b3b-42b7-962d-b59d2231f4bc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.214249 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.214165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.214357 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.214264 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:23.214357 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.214277 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:23.214357 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.214341 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:23.714319318 +0000 UTC m=+34.578526413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:23.214528 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.214445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.214751 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.214728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.215027 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.215005 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a978e90a-63cc-4020-bcf6-ed652af9c29e-tmp\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.218970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.218661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f344173d-b945-4345-8a34-a2de4986ae42-cert\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.218970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.218751 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-ca\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.218970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.218777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a978e90a-63cc-4020-bcf6-ed652af9c29e-klusterlet-config\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.218970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.218918 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.218970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.218927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.219316 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.219260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e18ae241-143b-49f6-9f40-989768a05555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.219859 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.219428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.219859 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.219680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.222888 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.221664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14102720-7b3b-42b7-962d-b59d2231f4bc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.222888 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.222382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2ks\" (UniqueName: \"kubernetes.io/projected/f344173d-b945-4345-8a34-a2de4986ae42-kube-api-access-pg2ks\") pod \"ingress-canary-kmprg\" (UID: \"f344173d-b945-4345-8a34-a2de4986ae42\") " pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.223885 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.223857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxjh\" (UniqueName: \"kubernetes.io/projected/e18ae241-143b-49f6-9f40-989768a05555-kube-api-access-bmxjh\") pod \"managed-serviceaccount-addon-agent-5b946d65f6-snhh5\" (UID: \"e18ae241-143b-49f6-9f40-989768a05555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.225358 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.225334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.225492 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.225462 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtrz\" (UniqueName: \"kubernetes.io/projected/14102720-7b3b-42b7-962d-b59d2231f4bc-kube-api-access-kwtrz\") pod \"cluster-proxy-proxy-agent-c6fcd59b7-29vsc\" (UID: \"14102720-7b3b-42b7-962d-b59d2231f4bc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.225924 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.225903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8872k\" (UniqueName: \"kubernetes.io/projected/a978e90a-63cc-4020-bcf6-ed652af9c29e-kube-api-access-8872k\") pod \"klusterlet-addon-workmgr-56d95f57d6-6rwl9\" (UID: \"a978e90a-63cc-4020-bcf6-ed652af9c29e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.226315 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.226295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r844p\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.277265 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.277228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:23.282044 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.282007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:23.304289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.304268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:21:23.314525 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.314493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc81df56-c592-44b7-b55e-8a7a815dcd94-config-volume\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.314625 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.314537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.314625 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.314571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:23.314747 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.314630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc81df56-c592-44b7-b55e-8a7a815dcd94-tmp-dir\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.314747 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.314685 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:23.314850 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.314746 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:21:23.314850 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.314774 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:23.814752574 +0000 UTC m=+34.678959670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:23.314850 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.314807 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:55.31479143 +0000 UTC m=+66.178998520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 02:21:23.314987 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.314690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xdm\" (UniqueName: \"kubernetes.io/projected/fc81df56-c592-44b7-b55e-8a7a815dcd94-kube-api-access-c6xdm\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.315105 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.315088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc81df56-c592-44b7-b55e-8a7a815dcd94-tmp-dir\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.315180 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.315163 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc81df56-c592-44b7-b55e-8a7a815dcd94-config-volume\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.317454 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.317434 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" Sep 08 02:21:23.324402 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.324377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xdm\" (UniqueName: \"kubernetes.io/projected/fc81df56-c592-44b7-b55e-8a7a815dcd94-kube-api-access-c6xdm\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.343328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.343304 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmprg" Sep 08 02:21:23.415901 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.415864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:23.416045 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.415949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:23.416045 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416011 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 02:21:23.416171 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416051 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 02:21:23.416171 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416065 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 02:21:23.416171 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416077 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret podName:22fd687d-cbcc-47c4-9269-f3b113bf9bfe nodeName:}" failed. No retries permitted until 2026-09-08 02:21:55.416061357 +0000 UTC m=+66.280268444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret") pod "global-pull-secret-syncer-49fq7" (UID: "22fd687d-cbcc-47c4-9269-f3b113bf9bfe") : object "kube-system"/"original-pull-secret" not registered Sep 08 02:21:23.416171 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416078 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9s74n for pod openshift-network-diagnostics/network-check-target-hxvjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:21:23.416171 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.416126 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n podName:f4949389-2f0f-4fb7-992b-20abc8a493dd nodeName:}" failed. No retries permitted until 2026-09-08 02:21:55.416116244 +0000 UTC m=+66.280323332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9s74n" (UniqueName: "kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n") pod "network-check-target-hxvjp" (UID: "f4949389-2f0f-4fb7-992b-20abc8a493dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 02:21:23.658621 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.658583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:23.658793 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.658583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:23.658873 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.658598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:23.662148 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.661834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 02:21:23.662148 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.661937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42xzn\"" Sep 08 02:21:23.662148 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.661985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m9nsl\"" Sep 08 02:21:23.662148 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.662059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 02:21:23.662548 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.662528 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 02:21:23.662711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.662695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 02:21:23.717991 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.717964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:23.718173 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.718155 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:23.718237 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.718177 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:23.718275 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.718241 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:24.718220669 +0000 UTC m=+35.582427761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:23.819403 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:23.819364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:23.819574 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.819553 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:23.819643 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:23.819631 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:24.819610532 +0000 UTC m=+35.683817625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:24.712130 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.712099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmprg"] Sep 08 02:21:24.716118 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.716061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5"] Sep 08 02:21:24.718931 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.717458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9"] Sep 08 02:21:24.718931 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.718407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc"] Sep 08 02:21:24.721721 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:24.721538 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda978e90a_63cc_4020_bcf6_ed652af9c29e.slice/crio-d79b3ff26845a7b4bd70f6f8ce68cf005d938d770c8596e3e4d66ecab3f9dfac WatchSource:0}: Error finding container d79b3ff26845a7b4bd70f6f8ce68cf005d938d770c8596e3e4d66ecab3f9dfac: Status 404 returned error can't find the container with id d79b3ff26845a7b4bd70f6f8ce68cf005d938d770c8596e3e4d66ecab3f9dfac Sep 08 02:21:24.722116 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:24.722071 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14102720_7b3b_42b7_962d_b59d2231f4bc.slice/crio-a3a6268d23af21a758504eb9714192ad982a5e6a9d3e05ad5b3a97ba176e2a5a WatchSource:0}: Error finding container a3a6268d23af21a758504eb9714192ad982a5e6a9d3e05ad5b3a97ba176e2a5a: Status 404 returned error can't find the container with id a3a6268d23af21a758504eb9714192ad982a5e6a9d3e05ad5b3a97ba176e2a5a Sep 08 02:21:24.723265 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:24.723186 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf344173d_b945_4345_8a34_a2de4986ae42.slice/crio-7fe645aa656f03f90ebafab220a7ba316a017b3f6d388fdc9a66457418bcb097 WatchSource:0}: Error finding container 7fe645aa656f03f90ebafab220a7ba316a017b3f6d388fdc9a66457418bcb097: Status 404 returned error can't find the container with id 7fe645aa656f03f90ebafab220a7ba316a017b3f6d388fdc9a66457418bcb097 Sep 08 02:21:24.723741 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:24.723718 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode18ae241_143b_49f6_9f40_989768a05555.slice/crio-ec69ec4a8657c4b268db45ce237138cde87df4b100f47e40f6b98f8bb07094bb WatchSource:0}: Error finding container ec69ec4a8657c4b268db45ce237138cde87df4b100f47e40f6b98f8bb07094bb: Status 404 returned error can't find the container with id ec69ec4a8657c4b268db45ce237138cde87df4b100f47e40f6b98f8bb07094bb Sep 08 02:21:24.727770 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.727717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:24.727932 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:24.727910 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:24.728015 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:24.727932 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:24.728015 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:24.728014 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:26.727995559 +0000 UTC m=+37.592202648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:24.828559 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.828401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:24.828559 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:24.828552 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:24.828756 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:24.828628 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:26.82860786 +0000 UTC m=+37.692814959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:24.846485 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.846455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmprg" event={"ID":"f344173d-b945-4345-8a34-a2de4986ae42","Type":"ContainerStarted","Data":"7fe645aa656f03f90ebafab220a7ba316a017b3f6d388fdc9a66457418bcb097"} Sep 08 02:21:24.847660 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.847624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerStarted","Data":"a3a6268d23af21a758504eb9714192ad982a5e6a9d3e05ad5b3a97ba176e2a5a"} Sep 08 02:21:24.848686 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.848658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" event={"ID":"a978e90a-63cc-4020-bcf6-ed652af9c29e","Type":"ContainerStarted","Data":"d79b3ff26845a7b4bd70f6f8ce68cf005d938d770c8596e3e4d66ecab3f9dfac"} Sep 08 02:21:24.849845 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.849814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" event={"ID":"e18ae241-143b-49f6-9f40-989768a05555","Type":"ContainerStarted","Data":"ec69ec4a8657c4b268db45ce237138cde87df4b100f47e40f6b98f8bb07094bb"} Sep 08 02:21:24.852593 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:24.852574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerStarted","Data":"39e7e9895c789cf0971ef74922ed5080bf60147c04ec1937eb4ac0614ff081dc"} Sep 08 02:21:25.869850 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:25.868890 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="39e7e9895c789cf0971ef74922ed5080bf60147c04ec1937eb4ac0614ff081dc" exitCode=0 Sep 08 02:21:25.869850 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:25.868955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"39e7e9895c789cf0971ef74922ed5080bf60147c04ec1937eb4ac0614ff081dc"} Sep 08 02:21:26.748202 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:26.747547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:26.748202 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:26.747759 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:26.748202 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:26.747774 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:26.748202 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:26.747832 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:30.747813947 +0000 UTC m=+41.612021048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:26.848981 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:26.848476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:26.848981 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:26.848671 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:26.848981 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:26.848731 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:30.848712858 +0000 UTC m=+41.712919960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:26.880664 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:26.879784 2581 generic.go:356] "Generic (PLEG): container finished" podID="dc5c85d6-40b3-419e-b4c2-e48b4ef86626" containerID="b3166fb7f91c875bab5bf0a3d97c5d8d97f33b525bc804e06ad0c05dbbf938c2" exitCode=0 Sep 08 02:21:26.880664 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:26.879857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerDied","Data":"b3166fb7f91c875bab5bf0a3d97c5d8d97f33b525bc804e06ad0c05dbbf938c2"} Sep 08 02:21:27.888500 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:27.888450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" event={"ID":"dc5c85d6-40b3-419e-b4c2-e48b4ef86626","Type":"ContainerStarted","Data":"a8d51970308ab678d9870d72740f094938bb8e1a3a46e06823fe837430768583"} Sep 08 02:21:27.915100 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:27.915045 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzlzv" podStartSLOduration=8.170955033 podStartE2EDuration="37.915028786s" totalImagesPullingTime="29.744073753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:27.913040457 +0000 UTC m=+38.777247571" watchObservedRunningTime="2026-09-08 02:21:27.915028786 +0000 UTC m=+38.779235896" Sep 08 02:21:28.036966 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:28.036913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:28.100516 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:28.100482 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:28.455910 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:28.455853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:28.514664 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:28.514629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:29.399331 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:29.399298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:29.461950 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:29.461906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" limit=1024 Sep 08 02:21:30.781671 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:30.781628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:30.782102 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:30.781791 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:30.782102 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:30.781813 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:30.782102 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:30.781925 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:38.781907746 +0000 UTC m=+49.646114834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:30.882912 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:30.882875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:30.883084 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:30.883059 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:30.883167 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:30.883152 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:38.883119925 +0000 UTC m=+49.747327018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:33.906655 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.906618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmprg" event={"ID":"f344173d-b945-4345-8a34-a2de4986ae42","Type":"ContainerStarted","Data":"55f022efee523295043cc811ab580401af6f61ba9d1c671f1da28acf4b334edc"} Sep 08 02:21:33.908602 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.908575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerStarted","Data":"8b7594ed288a2e24472cf44b2130087d97f03a03475fb33fd6a4a0f97887d072"} Sep 08 02:21:33.908676 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.908624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerStarted","Data":"764afb41b7e118dee20ef135f957380861948116a24a13af6692a27b8a6c10e2"} Sep 08 02:21:33.910094 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.910073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" event={"ID":"a978e90a-63cc-4020-bcf6-ed652af9c29e","Type":"ContainerStarted","Data":"a9b8ef4c7f9e48484fd05498f0706d889bcab5718fab669d2bbe7359aca5d43c"} Sep 08 02:21:33.910261 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.910247 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:33.911669 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.911642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" event={"ID":"e18ae241-143b-49f6-9f40-989768a05555","Type":"ContainerStarted","Data":"1e1d3e3ca23362e3a4f6bb787143c84c2d33cbd0b66397f15fe0bb1580f8ce05"} Sep 08 02:21:33.912169 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.912131 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" Sep 08 02:21:33.925947 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.925904 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kmprg" podStartSLOduration=3.097119572 podStartE2EDuration="11.925892115s" totalImagesPullingTime="8.828772543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:33.925773107 +0000 UTC m=+44.789980281" watchObservedRunningTime="2026-09-08 02:21:33.925892115 +0000 UTC m=+44.790099227" Sep 08 02:21:33.947104 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.947060 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56d95f57d6-6rwl9" podStartSLOduration=33.105593949 podStartE2EDuration="41.947045027s" totalImagesPullingTime="8.841451078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:33.945965328 +0000 UTC m=+44.810172438" watchObservedRunningTime="2026-09-08 02:21:33.947045027 +0000 UTC m=+44.811252138" Sep 08 02:21:33.962532 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:33.962495 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b946d65f6-snhh5" podStartSLOduration=33.126126646 podStartE2EDuration="41.962482579s" totalImagesPullingTime="8.836355933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:33.96170155 +0000 UTC m=+44.825908662" watchObservedRunningTime="2026-09-08 02:21:33.962482579 +0000 UTC m=+44.826689689" Sep 08 02:21:34.917075 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:34.917035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerStarted","Data":"d30bf704cbd23d501a936eb9f52704617acce61f24c8d1fcbb1c835f9075c7e9"} Sep 08 02:21:34.940234 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:34.940193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" podStartSLOduration=34.083030358 podStartE2EDuration="42.940180155s" totalImagesPullingTime="8.857149797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:34.939114948 +0000 UTC m=+45.803322074" watchObservedRunningTime="2026-09-08 02:21:34.940180155 +0000 UTC m=+45.804387297" Sep 08 02:21:38.846534 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:38.846495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:38.846908 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:38.846645 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:38.846908 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:38.846661 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:38.846908 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:38.846721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:21:54.846702857 +0000 UTC m=+65.710909959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:38.947879 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:38.947843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:38.948053 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:38.948019 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:38.948132 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:38.948095 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:21:54.948072729 +0000 UTC m=+65.812279837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:49.841700 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:49.841669 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7gdb" Sep 08 02:21:54.859150 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:54.859109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:21:54.859559 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:54.859265 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:21:54.859559 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:54.859283 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:21:54.859559 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:54.859336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:22:26.859321463 +0000 UTC m=+97.723528551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:21:54.960496 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:54.960469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:21:54.960633 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:54.960618 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:21:54.960695 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:54.960684 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:26.960668472 +0000 UTC m=+97.824875564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:21:55.362644 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.362613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:21:55.365500 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.365481 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 02:21:55.373748 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:55.373728 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 02:21:55.373835 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:21:55.373816 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs podName:ab21198a-a79c-425b-b1b8-11129df076f9 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:59.373794103 +0000 UTC m=+130.238001208 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs") pod "network-metrics-daemon-8fdjx" (UID: "ab21198a-a79c-425b-b1b8-11129df076f9") : secret "metrics-daemon-secret" not found Sep 08 02:21:55.463782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.463735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:55.463964 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.463865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:55.466888 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.466866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 02:21:55.467019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.466982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 02:21:55.476560 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.476541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 02:21:55.476975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.476957 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22fd687d-cbcc-47c4-9269-f3b113bf9bfe-original-pull-secret\") pod \"global-pull-secret-syncer-49fq7\" (UID: \"22fd687d-cbcc-47c4-9269-f3b113bf9bfe\") " pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:55.484877 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.484859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49fq7" Sep 08 02:21:55.486857 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.486837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s74n\" (UniqueName: \"kubernetes.io/projected/f4949389-2f0f-4fb7-992b-20abc8a493dd-kube-api-access-9s74n\") pod \"network-check-target-hxvjp\" (UID: \"f4949389-2f0f-4fb7-992b-20abc8a493dd\") " pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:55.772876 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.772816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m9nsl\"" Sep 08 02:21:55.780688 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.780635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:21:55.781638 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.781616 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49fq7"] Sep 08 02:21:55.784582 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:55.784561 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fd687d_cbcc_47c4_9269_f3b113bf9bfe.slice/crio-05c81bde44714fb1a4257a9958247f8d377fab9c2d0a2c45f435883bdd095a39 WatchSource:0}: Error finding container 05c81bde44714fb1a4257a9958247f8d377fab9c2d0a2c45f435883bdd095a39: Status 404 returned error can't find the container with id 05c81bde44714fb1a4257a9958247f8d377fab9c2d0a2c45f435883bdd095a39 Sep 08 02:21:55.980485 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:55.980448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49fq7" event={"ID":"22fd687d-cbcc-47c4-9269-f3b113bf9bfe","Type":"ContainerStarted","Data":"05c81bde44714fb1a4257a9958247f8d377fab9c2d0a2c45f435883bdd095a39"} Sep 08 02:21:56.072425 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:56.072399 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxvjp"] Sep 08 02:21:56.076073 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:21:56.076045 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4949389_2f0f_4fb7_992b_20abc8a493dd.slice/crio-939a2835d3731c66279d0be292283ac799b712700103d1f5c55322e77f314d63 WatchSource:0}: Error finding container 939a2835d3731c66279d0be292283ac799b712700103d1f5c55322e77f314d63: Status 404 returned error can't find the container with id 939a2835d3731c66279d0be292283ac799b712700103d1f5c55322e77f314d63 Sep 08 02:21:56.986466 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:21:56.986427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxvjp" event={"ID":"f4949389-2f0f-4fb7-992b-20abc8a493dd","Type":"ContainerStarted","Data":"939a2835d3731c66279d0be292283ac799b712700103d1f5c55322e77f314d63"} Sep 08 02:22:01.002035 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:01.001939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49fq7" event={"ID":"22fd687d-cbcc-47c4-9269-f3b113bf9bfe","Type":"ContainerStarted","Data":"65d7a409a27775b996217ca8744bb1a2e2c413181a871f630ea8e3867bbc6eb5"} Sep 08 02:22:01.003510 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:01.003483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxvjp" event={"ID":"f4949389-2f0f-4fb7-992b-20abc8a493dd","Type":"ContainerStarted","Data":"a7ecd04e2ae85cbbb0a17553141c51f189539c3c447ac00768a1f03a481810c5"} Sep 08 02:22:01.003621 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:01.003609 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:22:01.034047 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:01.033997 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxvjp" podStartSLOduration=66.542996881 podStartE2EDuration="1m11.033981982s" totalImagesPullingTime="4.490985101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:22:01.033539687 +0000 UTC m=+71.897746801" watchObservedRunningTime="2026-09-08 02:22:01.033981982 +0000 UTC m=+71.898189091" Sep 08 02:22:01.034448 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:01.034417 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-49fq7" podStartSLOduration=66.245783427 podStartE2EDuration="1m11.034411578s" totalImagesPullingTime="4.788628151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:22:01.018398029 +0000 UTC m=+71.882605144" watchObservedRunningTime="2026-09-08 02:22:01.034411578 +0000 UTC m=+71.898618688" Sep 08 02:22:26.894015 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:26.893978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:22:26.894449 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:26.894085 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 02:22:26.894449 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:26.894096 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6f85d64-5pjdb: secret "image-registry-tls" not found Sep 08 02:22:26.894449 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:26.894165 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls podName:1065a685-7d37-4975-8b2c-9fa93a1c517e nodeName:}" failed. No retries permitted until 2026-09-08 02:23:30.894131238 +0000 UTC m=+161.758338325 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls") pod "image-registry-56b6f85d64-5pjdb" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e") : secret "image-registry-tls" not found Sep 08 02:22:26.994725 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:26.994686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:22:26.994879 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:26.994856 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 02:22:26.994962 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:26.994949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls podName:fc81df56-c592-44b7-b55e-8a7a815dcd94 nodeName:}" failed. No retries permitted until 2026-09-08 02:23:30.994927278 +0000 UTC m=+161.859134387 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls") pod "dns-default-dr8xs" (UID: "fc81df56-c592-44b7-b55e-8a7a815dcd94") : secret "dns-default-metrics-tls" not found Sep 08 02:22:32.008562 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:32.008532 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxvjp" Sep 08 02:22:43.916589 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.916560 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbj65"] Sep 08 02:22:43.919530 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.919506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:43.922369 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.922350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 02:22:43.922631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.922617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nngdf\"" Sep 08 02:22:43.923566 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.923549 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 02:22:43.923616 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.923582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 02:22:43.923656 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.923617 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 02:22:43.931333 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:43.931311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbj65"] Sep 08 02:22:44.009046 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.009009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c719264d-2838-4148-9a7f-9e77ec64b873-data-volume\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.009242 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.009080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmsv\" (UniqueName: \"kubernetes.io/projected/c719264d-2838-4148-9a7f-9e77ec64b873-kube-api-access-9hmsv\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.009242 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.009112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c719264d-2838-4148-9a7f-9e77ec64b873-crio-socket\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.009242 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.009167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.009242 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.009202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109663 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c719264d-2838-4148-9a7f-9e77ec64b873-data-volume\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmsv\" (UniqueName: \"kubernetes.io/projected/c719264d-2838-4148-9a7f-9e77ec64b873-kube-api-access-9hmsv\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c719264d-2838-4148-9a7f-9e77ec64b873-crio-socket\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109876 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.109786 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:22:44.109876 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c719264d-2838-4148-9a7f-9e77ec64b873-crio-socket\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.109876 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.109850 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:44.609835971 +0000 UTC m=+115.474043059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : configmap "kube-rbac-proxy" not found Sep 08 02:22:44.110014 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.110014 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.109950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c719264d-2838-4148-9a7f-9e77ec64b873-data-volume\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.110014 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.110006 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:22:44.110164 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.110047 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:44.610037118 +0000 UTC m=+115.474244212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : secret "insights-runtime-extractor-tls" not found Sep 08 02:22:44.118222 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.118199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmsv\" (UniqueName: \"kubernetes.io/projected/c719264d-2838-4148-9a7f-9e77ec64b873-kube-api-access-9hmsv\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.614359 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.614320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.614518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.614366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:44.614518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.614437 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:22:44.614518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.614517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:45.614503108 +0000 UTC m=+116.478710200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : configmap "kube-rbac-proxy" not found Sep 08 02:22:44.614667 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.614541 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:22:44.614667 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:44.614594 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:45.614581771 +0000 UTC m=+116.478788859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : secret "insights-runtime-extractor-tls" not found Sep 08 02:22:44.821344 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.821309 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rz5zs"] Sep 08 02:22:44.824133 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.824116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" Sep 08 02:22:44.826851 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.826832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-br9qn\"" Sep 08 02:22:44.837195 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.837175 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rz5zs"] Sep 08 02:22:44.917096 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:44.917008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qvw\" (UniqueName: \"kubernetes.io/projected/c3dae66b-00ec-4896-a9a8-3fd77e1ab498-kube-api-access-65qvw\") pod \"network-check-source-685456655f-rz5zs\" (UID: \"c3dae66b-00ec-4896-a9a8-3fd77e1ab498\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" Sep 08 02:22:45.017793 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.017751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65qvw\" (UniqueName: \"kubernetes.io/projected/c3dae66b-00ec-4896-a9a8-3fd77e1ab498-kube-api-access-65qvw\") pod \"network-check-source-685456655f-rz5zs\" (UID: \"c3dae66b-00ec-4896-a9a8-3fd77e1ab498\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" Sep 08 02:22:45.026410 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.026391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qvw\" (UniqueName: \"kubernetes.io/projected/c3dae66b-00ec-4896-a9a8-3fd77e1ab498-kube-api-access-65qvw\") pod \"network-check-source-685456655f-rz5zs\" (UID: \"c3dae66b-00ec-4896-a9a8-3fd77e1ab498\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" Sep 08 02:22:45.132868 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.132843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" Sep 08 02:22:45.399243 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.399210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rz5zs"] Sep 08 02:22:45.402020 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:22:45.401997 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3dae66b_00ec_4896_a9a8_3fd77e1ab498.slice/crio-12ecb949c494d2e040d1a4e10eaf7ecadbde1b6e1a5ab39b504758b07ade85ed WatchSource:0}: Error finding container 12ecb949c494d2e040d1a4e10eaf7ecadbde1b6e1a5ab39b504758b07ade85ed: Status 404 returned error can't find the container with id 12ecb949c494d2e040d1a4e10eaf7ecadbde1b6e1a5ab39b504758b07ade85ed Sep 08 02:22:45.638287 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.638252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:45.638471 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.638371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:45.638471 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:45.638390 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:22:45.638471 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:45.638448 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:22:45.638471 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:45.638464 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:47.638446771 +0000 UTC m=+118.502653863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : secret "insights-runtime-extractor-tls" not found Sep 08 02:22:45.638651 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:45.638504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:47.638489027 +0000 UTC m=+118.502696140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : configmap "kube-rbac-proxy" not found Sep 08 02:22:45.873705 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:45.873675 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fpdgq_7824f8c1-1a41-4479-8ff8-2e9b29bdb559/dns-node-resolver/0.log" Sep 08 02:22:46.139573 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:46.139484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" event={"ID":"c3dae66b-00ec-4896-a9a8-3fd77e1ab498","Type":"ContainerStarted","Data":"9b7bf6ab4c4256bac0ec0a129d3dca1bc5246208367441dffb6b6721714f868b"} Sep 08 02:22:46.139573 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:46.139535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" event={"ID":"c3dae66b-00ec-4896-a9a8-3fd77e1ab498","Type":"ContainerStarted","Data":"12ecb949c494d2e040d1a4e10eaf7ecadbde1b6e1a5ab39b504758b07ade85ed"} Sep 08 02:22:46.161339 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:46.161292 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-rz5zs" podStartSLOduration=2.161277824 podStartE2EDuration="2.161277824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:22:46.160556318 +0000 UTC m=+117.024763440" watchObservedRunningTime="2026-09-08 02:22:46.161277824 +0000 UTC m=+117.025484933" Sep 08 02:22:46.873980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:46.873952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jltf6_521996c4-d0ba-41fc-bd0e-ebc8b04ff01c/node-ca/0.log" Sep 08 02:22:47.654582 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:47.654544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:47.655019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:47.654600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:47.655019 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:47.654695 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:22:47.655019 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:47.654745 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:22:47.655019 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:47.654770 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:51.654752707 +0000 UTC m=+122.518959794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : configmap "kube-rbac-proxy" not found Sep 08 02:22:47.655019 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:47.654796 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:51.654781435 +0000 UTC m=+122.518988527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : secret "insights-runtime-extractor-tls" not found Sep 08 02:22:47.677452 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:47.677427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmprg_f344173d-b945-4345-8a34-a2de4986ae42/serve-healthcheck-canary/0.log" Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:51.679251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:51.679316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:51.679454 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:51.679518 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:59.679500497 +0000 UTC m=+130.543707599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : secret "insights-runtime-extractor-tls" not found Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:51.679979 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 02:22:51.681518 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:22:51.680038 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm podName:c719264d-2838-4148-9a7f-9e77ec64b873 nodeName:}" failed. No retries permitted until 2026-09-08 02:22:59.680021936 +0000 UTC m=+130.544229031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbj65" (UID: "c719264d-2838-4148-9a7f-9e77ec64b873") : configmap "kube-rbac-proxy" not found Sep 08 02:22:59.432676 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.432642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:22:59.434972 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.434950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab21198a-a79c-425b-b1b8-11129df076f9-metrics-certs\") pod \"network-metrics-daemon-8fdjx\" (UID: \"ab21198a-a79c-425b-b1b8-11129df076f9\") " pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:22:59.679613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.679585 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42xzn\"" Sep 08 02:22:59.687824 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.687778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fdjx" Sep 08 02:22:59.734399 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.734364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:59.734539 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.734430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:59.735310 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.735253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c719264d-2838-4148-9a7f-9e77ec64b873-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:59.737739 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.737507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c719264d-2838-4148-9a7f-9e77ec64b873-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbj65\" (UID: \"c719264d-2838-4148-9a7f-9e77ec64b873\") " pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:59.829882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.829845 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nngdf\"" Sep 08 02:22:59.838309 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.838281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbj65" Sep 08 02:22:59.954797 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:22:59.954775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8fdjx"] Sep 08 02:22:59.957105 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:22:59.957082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab21198a_a79c_425b_b1b8_11129df076f9.slice/crio-30fd5d0db231d1d3bdfbf0c4ac28b7032e8ffe5443d2f939146dbaab32488e8e WatchSource:0}: Error finding container 30fd5d0db231d1d3bdfbf0c4ac28b7032e8ffe5443d2f939146dbaab32488e8e: Status 404 returned error can't find the container with id 30fd5d0db231d1d3bdfbf0c4ac28b7032e8ffe5443d2f939146dbaab32488e8e Sep 08 02:23:00.110252 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:00.110220 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbj65"] Sep 08 02:23:00.112820 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:23:00.112796 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc719264d_2838_4148_9a7f_9e77ec64b873.slice/crio-27756c604c2d6979a5e4664222ff4fa3827b684b6a8a5d101595a091c6decdf8 WatchSource:0}: Error finding container 27756c604c2d6979a5e4664222ff4fa3827b684b6a8a5d101595a091c6decdf8: Status 404 returned error can't find the container with id 27756c604c2d6979a5e4664222ff4fa3827b684b6a8a5d101595a091c6decdf8 Sep 08 02:23:00.183796 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:00.183760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbj65" event={"ID":"c719264d-2838-4148-9a7f-9e77ec64b873","Type":"ContainerStarted","Data":"be800e960eec70f367f378ad1be734a4af45b68e3347a82e26796d4f71d56101"} Sep 08 02:23:00.183941 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:00.183826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbj65" event={"ID":"c719264d-2838-4148-9a7f-9e77ec64b873","Type":"ContainerStarted","Data":"27756c604c2d6979a5e4664222ff4fa3827b684b6a8a5d101595a091c6decdf8"} Sep 08 02:23:00.184943 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:00.184919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fdjx" event={"ID":"ab21198a-a79c-425b-b1b8-11129df076f9","Type":"ContainerStarted","Data":"30fd5d0db231d1d3bdfbf0c4ac28b7032e8ffe5443d2f939146dbaab32488e8e"} Sep 08 02:23:01.189446 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:01.189410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbj65" event={"ID":"c719264d-2838-4148-9a7f-9e77ec64b873","Type":"ContainerStarted","Data":"e2de980e2572d32489d27987f92809a2c087987393d4be4bed4c7da035635f3b"} Sep 08 02:23:01.191042 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:01.191021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fdjx" event={"ID":"ab21198a-a79c-425b-b1b8-11129df076f9","Type":"ContainerStarted","Data":"051160b6597170227ae9465b12f2a9693b59c746e5f5b97f20f2e5a0cdfeed3c"} Sep 08 02:23:01.191165 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:01.191062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fdjx" event={"ID":"ab21198a-a79c-425b-b1b8-11129df076f9","Type":"ContainerStarted","Data":"3c86027481ba704069c100a554d58ec1cedd781c2d7d8644af5da7af9cdf9e14"} Sep 08 02:23:01.234356 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:01.234258 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8fdjx" podStartSLOduration=130.242924374 podStartE2EDuration="2m11.234241599s" totalImagesPullingTime="991.317225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:01.228916357 +0000 UTC m=+132.093123468" watchObservedRunningTime="2026-09-08 02:23:01.234241599 +0000 UTC m=+132.098448738" Sep 08 02:23:03.199509 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:03.199474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbj65" event={"ID":"c719264d-2838-4148-9a7f-9e77ec64b873","Type":"ContainerStarted","Data":"2553e08a087e477378739207a95678f7dcad77a4e6465ff58da49c2335c502eb"} Sep 08 02:23:03.220773 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:03.220727 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbj65" podStartSLOduration=18.188383451 podStartE2EDuration="20.220712238s" totalImagesPullingTime="2.032328787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:22:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:03.220085177 +0000 UTC m=+134.084292287" watchObservedRunningTime="2026-09-08 02:23:03.220712238 +0000 UTC m=+134.084919348" Sep 08 02:23:03.306506 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:03.306437 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" podUID="14102720-7b3b-42b7-962d-b59d2231f4bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 02:23:13.305482 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:13.305440 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" podUID="14102720-7b3b-42b7-962d-b59d2231f4bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 02:23:21.884354 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.884316 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2vdz6"] Sep 08 02:23:21.887537 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.887521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.893441 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.893374 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 02:23:21.894486 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mjs9s\"" Sep 08 02:23:21.894486 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894477 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 02:23:21.894486 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894468 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 02:23:21.894691 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894500 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 02:23:21.894691 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 02:23:21.894691 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.894635 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 02:23:21.995417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-textfile\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995417 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-metrics-client-ca\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-root\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-tls\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-wtmp\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-sys\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995631 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:21.995809 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:21.995633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdnq\" (UniqueName: \"kubernetes.io/projected/a3d077e9-0587-42be-94d4-b90822427d27-kube-api-access-2cdnq\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096672 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-textfile\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096672 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-metrics-client-ca\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096895 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-root\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096895 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-tls\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096895 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.096895 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-wtmp\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-root\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-sys\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.096980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdnq\" (UniqueName: \"kubernetes.io/projected/a3d077e9-0587-42be-94d4-b90822427d27-kube-api-access-2cdnq\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.097036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-wtmp\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.097043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-textfile\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097097 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.097053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d077e9-0587-42be-94d4-b90822427d27-sys\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097407 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.097348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-metrics-client-ca\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.097465 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.097444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-accelerators-collector-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.099043 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.099025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-tls\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.099182 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.099129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d077e9-0587-42be-94d4-b90822427d27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.108557 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.108529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdnq\" (UniqueName: \"kubernetes.io/projected/a3d077e9-0587-42be-94d4-b90822427d27-kube-api-access-2cdnq\") pod \"node-exporter-2vdz6\" (UID: \"a3d077e9-0587-42be-94d4-b90822427d27\") " pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.196669 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.196599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2vdz6" Sep 08 02:23:22.206533 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:23:22.206510 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d077e9_0587_42be_94d4_b90822427d27.slice/crio-7f07cda4038cbda5e7dbc1313e61cc58d80c276fa882b68ed3288344bb3ab1e1 WatchSource:0}: Error finding container 7f07cda4038cbda5e7dbc1313e61cc58d80c276fa882b68ed3288344bb3ab1e1: Status 404 returned error can't find the container with id 7f07cda4038cbda5e7dbc1313e61cc58d80c276fa882b68ed3288344bb3ab1e1 Sep 08 02:23:22.259345 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:22.259312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vdz6" event={"ID":"a3d077e9-0587-42be-94d4-b90822427d27","Type":"ContainerStarted","Data":"7f07cda4038cbda5e7dbc1313e61cc58d80c276fa882b68ed3288344bb3ab1e1"} Sep 08 02:23:23.305318 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:23.305283 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" podUID="14102720-7b3b-42b7-962d-b59d2231f4bc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 02:23:23.305575 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:23.305357 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" Sep 08 02:23:23.305970 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:23.305933 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d30bf704cbd23d501a936eb9f52704617acce61f24c8d1fcbb1c835f9075c7e9"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 08 02:23:23.306016 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:23.305999 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" podUID="14102720-7b3b-42b7-962d-b59d2231f4bc" containerName="service-proxy" containerID="cri-o://d30bf704cbd23d501a936eb9f52704617acce61f24c8d1fcbb1c835f9075c7e9" gracePeriod=30 Sep 08 02:23:24.268064 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:24.268025 2581 generic.go:356] "Generic (PLEG): container finished" podID="a3d077e9-0587-42be-94d4-b90822427d27" containerID="84b55233d1e9e812c3cad499bf4553842ea79c03c68b9c59bbb50556332589cf" exitCode=0 Sep 08 02:23:24.268280 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:24.268114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vdz6" event={"ID":"a3d077e9-0587-42be-94d4-b90822427d27","Type":"ContainerDied","Data":"84b55233d1e9e812c3cad499bf4553842ea79c03c68b9c59bbb50556332589cf"} Sep 08 02:23:24.272769 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:24.272737 2581 generic.go:356] "Generic (PLEG): container finished" podID="14102720-7b3b-42b7-962d-b59d2231f4bc" containerID="d30bf704cbd23d501a936eb9f52704617acce61f24c8d1fcbb1c835f9075c7e9" exitCode=2 Sep 08 02:23:24.272873 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:24.272783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerDied","Data":"d30bf704cbd23d501a936eb9f52704617acce61f24c8d1fcbb1c835f9075c7e9"} Sep 08 02:23:24.272873 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:24.272813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6fcd59b7-29vsc" event={"ID":"14102720-7b3b-42b7-962d-b59d2231f4bc","Type":"ContainerStarted","Data":"e63ca28daca12b5fc2c9fa12a679062379f2ae87b4e3255efd305f481e71cd8a"} Sep 08 02:23:25.278353 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:25.278317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vdz6" event={"ID":"a3d077e9-0587-42be-94d4-b90822427d27","Type":"ContainerStarted","Data":"72893cca1c398a47f8f797421ee46c10e7dff89c942326a0817b65f6ae2f57ed"} Sep 08 02:23:25.278739 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:25.278367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2vdz6" event={"ID":"a3d077e9-0587-42be-94d4-b90822427d27","Type":"ContainerStarted","Data":"5add76fe3123ee2c3524a7222280054a7cb86db6b8a19706bfaf34dbe74bc01e"} Sep 08 02:23:25.305502 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:25.305460 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2vdz6" podStartSLOduration=3.206043415 podStartE2EDuration="4.30544163s" totalImagesPullingTime="1.040259342s" totalInitContainerRuntime="59.138873ms" isStatefulPod=true podCreationTimestamp="2026-09-08 02:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:25.303940082 +0000 UTC m=+156.168147192" watchObservedRunningTime="2026-09-08 02:23:25.30544163 +0000 UTC m=+156.169648733" Sep 08 02:23:25.968862 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:23:25.968817 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" Sep 08 02:23:26.054881 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:23:26.054841 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dr8xs" podUID="fc81df56-c592-44b7-b55e-8a7a815dcd94" Sep 08 02:23:26.282006 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:26.281924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:26.282006 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:26.281954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:30.961689 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:30.961635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:30.963992 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:30.963973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"image-registry-56b6f85d64-5pjdb\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:31.062115 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.062074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:31.064315 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.064293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc81df56-c592-44b7-b55e-8a7a815dcd94-metrics-tls\") pod \"dns-default-dr8xs\" (UID: \"fc81df56-c592-44b7-b55e-8a7a815dcd94\") " pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:31.086824 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.086793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56wgd\"" Sep 08 02:23:31.086824 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.086794 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tr26m\"" Sep 08 02:23:31.094203 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.094186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:31.094285 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.094269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:31.382154 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.382109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dr8xs"] Sep 08 02:23:31.384295 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.384269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:23:31.385167 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:23:31.385115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc81df56_c592_44b7_b55e_8a7a815dcd94.slice/crio-701b8deb31ee83c0baeb80491e4a67951bf3e6bd0dc01a30522cd02b890c3453 WatchSource:0}: Error finding container 701b8deb31ee83c0baeb80491e4a67951bf3e6bd0dc01a30522cd02b890c3453: Status 404 returned error can't find the container with id 701b8deb31ee83c0baeb80491e4a67951bf3e6bd0dc01a30522cd02b890c3453 Sep 08 02:23:31.386949 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:23:31.386871 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1065a685_7d37_4975_8b2c_9fa93a1c517e.slice/crio-d3bf457f5a590b7db1e26ea259fa1d9554b9f01b7b499469530cc0f4dcf0d284 WatchSource:0}: Error finding container d3bf457f5a590b7db1e26ea259fa1d9554b9f01b7b499469530cc0f4dcf0d284: Status 404 returned error can't find the container with id d3bf457f5a590b7db1e26ea259fa1d9554b9f01b7b499469530cc0f4dcf0d284 Sep 08 02:23:31.535226 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:31.535193 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:23:32.303394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:32.303351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" event={"ID":"1065a685-7d37-4975-8b2c-9fa93a1c517e","Type":"ContainerStarted","Data":"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a"} Sep 08 02:23:32.303873 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:32.303412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" event={"ID":"1065a685-7d37-4975-8b2c-9fa93a1c517e","Type":"ContainerStarted","Data":"d3bf457f5a590b7db1e26ea259fa1d9554b9f01b7b499469530cc0f4dcf0d284"} Sep 08 02:23:32.303873 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:32.303441 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:32.304907 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:32.304882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dr8xs" event={"ID":"fc81df56-c592-44b7-b55e-8a7a815dcd94","Type":"ContainerStarted","Data":"701b8deb31ee83c0baeb80491e4a67951bf3e6bd0dc01a30522cd02b890c3453"} Sep 08 02:23:32.330449 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:32.329040 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" podStartSLOduration=162.32902113 podStartE2EDuration="2m42.32902113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:32.3270467 +0000 UTC m=+163.191253815" watchObservedRunningTime="2026-09-08 02:23:32.32902113 +0000 UTC m=+163.193228241" Sep 08 02:23:33.309699 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:33.309662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dr8xs" event={"ID":"fc81df56-c592-44b7-b55e-8a7a815dcd94","Type":"ContainerStarted","Data":"e6640f8adb3da3211348319e7a8784bdb0a5c239640f57f2253000eed3624fa0"} Sep 08 02:23:33.310122 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:33.309719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dr8xs" event={"ID":"fc81df56-c592-44b7-b55e-8a7a815dcd94","Type":"ContainerStarted","Data":"115b69d382310d57a1eb67bd8b39496f4014af1ea96b1cf67da5f0aa644cfdff"} Sep 08 02:23:33.352699 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:33.352648 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dr8xs" podStartSLOduration=129.875720397 podStartE2EDuration="2m11.352631042s" totalImagesPullingTime="1.476910645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:33.35127372 +0000 UTC m=+164.215480829" watchObservedRunningTime="2026-09-08 02:23:33.352631042 +0000 UTC m=+164.216838152" Sep 08 02:23:34.312638 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:34.312599 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:44.319199 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:44.319115 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dr8xs" Sep 08 02:23:53.315561 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:53.315532 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:58.328457 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.328376 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" containerName="registry" containerID="cri-o://4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a" gracePeriod=30 Sep 08 02:23:58.560803 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.560777 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:58.656782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656691 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.656782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656739 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.656782 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657034 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656810 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r844p\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657034 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656874 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657034 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656898 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657034 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656934 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657034 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.656966 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets\") pod \"1065a685-7d37-4975-8b2c-9fa93a1c517e\" (UID: \"1065a685-7d37-4975-8b2c-9fa93a1c517e\") " Sep 08 02:23:58.657394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.657357 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:23:58.657633 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.657585 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:23:58.659442 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.659408 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p" (OuterVolumeSpecName: "kube-api-access-r844p") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "kube-api-access-r844p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:23:58.659549 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.659499 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:23:58.659613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.659563 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:23:58.659613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.659583 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:23:58.659613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.659596 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:23:58.665612 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.665588 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1065a685-7d37-4975-8b2c-9fa93a1c517e" (UID: "1065a685-7d37-4975-8b2c-9fa93a1c517e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:23:58.758227 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758184 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-bound-sa-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758227 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758226 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1065a685-7d37-4975-8b2c-9fa93a1c517e-ca-trust-extracted\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758227 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758237 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-trusted-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758434 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758274 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r844p\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-kube-api-access-r844p\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758434 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758283 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-tls\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758434 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758292 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-image-registry-private-configuration\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758434 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758301 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1065a685-7d37-4975-8b2c-9fa93a1c517e-registry-certificates\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:58.758434 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:58.758310 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1065a685-7d37-4975-8b2c-9fa93a1c517e-installation-pull-secrets\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:23:59.401789 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.401752 2581 generic.go:356] "Generic (PLEG): container finished" podID="1065a685-7d37-4975-8b2c-9fa93a1c517e" containerID="4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a" exitCode=0 Sep 08 02:23:59.402292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.401801 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" Sep 08 02:23:59.402292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.401821 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" event={"ID":"1065a685-7d37-4975-8b2c-9fa93a1c517e","Type":"ContainerDied","Data":"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a"} Sep 08 02:23:59.402292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.401861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b6f85d64-5pjdb" event={"ID":"1065a685-7d37-4975-8b2c-9fa93a1c517e","Type":"ContainerDied","Data":"d3bf457f5a590b7db1e26ea259fa1d9554b9f01b7b499469530cc0f4dcf0d284"} Sep 08 02:23:59.402292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.401881 2581 scope.go:117] "RemoveContainer" containerID="4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a" Sep 08 02:23:59.410823 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.410802 2581 scope.go:117] "RemoveContainer" containerID="4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a" Sep 08 02:23:59.411125 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:23:59.411105 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a\": container with ID starting with 4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a not found: ID does not exist" containerID="4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a" Sep 08 02:23:59.411203 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.411133 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a"} err="failed to get container status \"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a\": rpc error: code = NotFound desc = could not find container \"4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a\": container with ID starting with 4eb56bd3293a2f9d74b518ab023576ece4d512a6954512d83566d1e9670e485a not found: ID does not exist" Sep 08 02:23:59.423723 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.423698 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:23:59.427748 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.427728 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56b6f85d64-5pjdb"] Sep 08 02:23:59.663781 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:23:59.663705 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" path="/var/lib/kubelet/pods/1065a685-7d37-4975-8b2c-9fa93a1c517e/volumes" Sep 08 02:25:49.565919 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:25:49.565882 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 02:26:08.127059 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.127022 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch"] Sep 08 02:26:08.129402 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.127271 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" containerName="registry" Sep 08 02:26:08.129402 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.127283 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" containerName="registry" Sep 08 02:26:08.129402 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.127332 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1065a685-7d37-4975-8b2c-9fa93a1c517e" containerName="registry" Sep 08 02:26:08.130281 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.130266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.132735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.132713 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 08 02:26:08.133694 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.133674 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-spcsg\"" Sep 08 02:26:08.133800 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.133679 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 08 02:26:08.138896 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.138870 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch"] Sep 08 02:26:08.240305 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.240267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.240472 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.240333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.240472 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.240371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.340831 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.340796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.340991 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.340844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.340991 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.340870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.341214 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.341196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.341280 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.341262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.350669 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.350640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.439498 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.439416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:08.709457 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.709284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch"] Sep 08 02:26:08.711941 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:08.711908 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d70fb0b_9ca1_4c89_aa00_3b5fa9da04a6.slice/crio-d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f WatchSource:0}: Error finding container d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f: Status 404 returned error can't find the container with id d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f Sep 08 02:26:08.713923 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.713907 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 02:26:08.819306 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:08.819270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" event={"ID":"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6","Type":"ContainerStarted","Data":"d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f"} Sep 08 02:26:11.014352 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.014317 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:11.017538 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.017517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.020948 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.020920 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 08 02:26:11.021091 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.020950 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 08 02:26:11.021228 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.021210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8x5vs\"" Sep 08 02:26:11.021296 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.021231 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 08 02:26:11.033529 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.033506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:11.090128 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.090097 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:11.093466 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.093440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.096014 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.095982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-wmhnq\"" Sep 08 02:26:11.108786 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.108758 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:11.161482 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161671 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161671 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161671 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161671 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmt2\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.161882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.161778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262424 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262627 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262627 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262627 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262627 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262627 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmt2\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.262915 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9ms\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.262900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.263021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.263085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.263473 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.263099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.263807 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.263679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.265600 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.265539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.265996 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.265971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.274817 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.274793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.274975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.274855 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmt2\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.279018 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.278991 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np"] Sep 08 02:26:11.283410 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.283392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.300176 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.300132 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np"] Sep 08 02:26:11.330001 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.329971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:11.364224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364224 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9ms\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364459 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364743 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.364931 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.364903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.365495 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.365468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.365605 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.365531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.365816 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.365764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.366059 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.366033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.367720 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.367700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.368035 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.368009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.376366 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.376343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.377608 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.377580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9ms\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.406534 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.406503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:11.465175 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-kube-api-access-xq9gd\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465376 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd566e7-745a-49d3-821b-147d5408932e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465376 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465480 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465628 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd566e7-745a-49d3-821b-147d5408932e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465628 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.465918 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.465614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.512511 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.512477 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd"] Sep 08 02:26:11.515845 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.515795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.530157 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.530114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd"] Sep 08 02:26:11.567181 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-kube-api-access-xq9gd\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd566e7-745a-49d3-821b-147d5408932e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567784 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567610 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567784 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd566e7-745a-49d3-821b-147d5408932e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567784 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567784 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.567784 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.568084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.567845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.568084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.568009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.568307 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.568287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdd566e7-745a-49d3-821b-147d5408932e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.570232 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.570207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdd566e7-745a-49d3-821b-147d5408932e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.570334 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.570308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdd566e7-745a-49d3-821b-147d5408932e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.576574 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.576532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-kube-api-access-xq9gd\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.576891 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.576870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdd566e7-745a-49d3-821b-147d5408932e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np\" (UID: \"cdd566e7-745a-49d3-821b-147d5408932e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.596909 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.596878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:11.615953 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.615881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:11.617665 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:11.617635 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2de3cdc_c19e_4371_86a8_d9f58900bbc7.slice/crio-cf45a46846b7c2dc6244795be34fd98eed5b36c86ee8f2f9e07b0598f4966d4e WatchSource:0}: Error finding container cf45a46846b7c2dc6244795be34fd98eed5b36c86ee8f2f9e07b0598f4966d4e: Status 404 returned error can't find the container with id cf45a46846b7c2dc6244795be34fd98eed5b36c86ee8f2f9e07b0598f4966d4e Sep 08 02:26:11.669164 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669356 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669444 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s2d8\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-kube-api-access-6s2d8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669505 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669505 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669617 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669617 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669617 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.669772 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.669645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.693811 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.693768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:11.770531 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770531 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s2d8\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-kube-api-access-6s2d8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770861 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770861 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770961 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.770961 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.770867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.771081 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.771055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.771156 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.771083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.771219 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.771182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.771354 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.771333 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.773384 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.773362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.773617 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.773601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.779980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.779955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.780463 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.780440 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s2d8\" (UniqueName: \"kubernetes.io/projected/cbabf975-d8f0-4b21-9dc2-4c2c9eec368b-kube-api-access-6s2d8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzdqd\" (UID: \"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.827322 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.827288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:11.831971 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.831934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" event={"ID":"d8892594-f8b3-49f9-b41a-78cc662c6b4f","Type":"ContainerStarted","Data":"9681a302f3eb453a29d8758dc64276948876bf3705ab304dc9f338a822f48678"} Sep 08 02:26:11.833423 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.833390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" event={"ID":"d2de3cdc-c19e-4371-86a8-d9f58900bbc7","Type":"ContainerStarted","Data":"cf45a46846b7c2dc6244795be34fd98eed5b36c86ee8f2f9e07b0598f4966d4e"} Sep 08 02:26:11.883095 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:11.883056 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np"] Sep 08 02:26:12.952923 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:12.952885 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr"] Sep 08 02:26:12.956543 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:12.956517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:12.965011 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:12.964970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr"] Sep 08 02:26:13.050547 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.050502 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7"] Sep 08 02:26:13.054217 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.054188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.061921 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.061878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7"] Sep 08 02:26:13.082743 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.082714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmwc\" (UniqueName: \"kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.083019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.082775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.083019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.082875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.156930 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.156895 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj"] Sep 08 02:26:13.160184 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.160159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.169040 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.169014 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj"] Sep 08 02:26:13.183479 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bl99\" (UniqueName: \"kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.183644 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmwc\" (UniqueName: \"kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.183644 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.183644 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.183644 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.183889 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.183693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.184055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.184032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.184055 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.184048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.192666 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.192641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmwc\" (UniqueName: \"kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.253049 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.252976 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm"] Sep 08 02:26:13.256611 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.256586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.265132 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.265071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm"] Sep 08 02:26:13.269086 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.269060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:13.284448 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.284569 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.284569 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.284670 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bl99\" (UniqueName: \"kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.284670 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.284670 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54jtg\" (UniqueName: \"kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.284872 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.284975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.284959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.293804 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.293774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bl99\" (UniqueName: \"kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.366515 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.366481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:13.385977 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.385941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54jtg\" (UniqueName: \"kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.386117 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.385993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sz2q\" (UniqueName: \"kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.386117 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.386117 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.386323 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.386323 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.386586 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.386676 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.386585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.395783 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.395756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54jtg\" (UniqueName: \"kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.470819 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.470781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:13.487376 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.487344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sz2q\" (UniqueName: \"kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.487522 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.487429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.487522 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.487456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.487866 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.487842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.488010 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.487880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.497636 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.497600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sz2q\" (UniqueName: \"kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.567676 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.567632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:13.660103 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:13.660069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd566e7_745a_49d3_821b_147d5408932e.slice/crio-31eb2bc519dd2d3ea8ac7fb462b855b75eb735489bc5ba81646e98ee3617662d WatchSource:0}: Error finding container 31eb2bc519dd2d3ea8ac7fb462b855b75eb735489bc5ba81646e98ee3617662d: Status 404 returned error can't find the container with id 31eb2bc519dd2d3ea8ac7fb462b855b75eb735489bc5ba81646e98ee3617662d Sep 08 02:26:13.843510 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.843406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" event={"ID":"cdd566e7-745a-49d3-821b-147d5408932e","Type":"ContainerStarted","Data":"31eb2bc519dd2d3ea8ac7fb462b855b75eb735489bc5ba81646e98ee3617662d"} Sep 08 02:26:13.960390 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.959952 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr"] Sep 08 02:26:13.971227 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.971105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd"] Sep 08 02:26:13.971463 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.971414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj"] Sep 08 02:26:13.972898 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:13.972835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7"] Sep 08 02:26:13.973052 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:13.973025 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbabf975_d8f0_4b21_9dc2_4c2c9eec368b.slice/crio-72b5415a7bd32a049d5cc3c389f1083197bdb9fcced02936aea180fea1a4fff6 WatchSource:0}: Error finding container 72b5415a7bd32a049d5cc3c389f1083197bdb9fcced02936aea180fea1a4fff6: Status 404 returned error can't find the container with id 72b5415a7bd32a049d5cc3c389f1083197bdb9fcced02936aea180fea1a4fff6 Sep 08 02:26:13.976486 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:13.976402 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c49f2f_6d07_47e6_9336_e8fd9fb61f23.slice/crio-343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183 WatchSource:0}: Error finding container 343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183: Status 404 returned error can't find the container with id 343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183 Sep 08 02:26:13.977902 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:13.977613 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579d4414_9e8d_4c18_823e_c7a6c96141af.slice/crio-c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9 WatchSource:0}: Error finding container c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9: Status 404 returned error can't find the container with id c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9 Sep 08 02:26:14.004937 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.004709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm"] Sep 08 02:26:14.019890 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:14.019822 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269f5f40_b6e1_43b3_a156_8773bf4f66ff.slice/crio-5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02 WatchSource:0}: Error finding container 5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02: Status 404 returned error can't find the container with id 5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02 Sep 08 02:26:14.853352 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.853312 2581 generic.go:356] "Generic (PLEG): container finished" podID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerID="a575b1aeca38a2549a4f81a642517726a7ae13c8aa6025e74a29f597ce54e6b0" exitCode=0 Sep 08 02:26:14.853544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.853415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" event={"ID":"579d4414-9e8d-4c18-823e-c7a6c96141af","Type":"ContainerDied","Data":"a575b1aeca38a2549a4f81a642517726a7ae13c8aa6025e74a29f597ce54e6b0"} Sep 08 02:26:14.853544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.853467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" event={"ID":"579d4414-9e8d-4c18-823e-c7a6c96141af","Type":"ContainerStarted","Data":"c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9"} Sep 08 02:26:14.857188 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.857157 2581 generic.go:356] "Generic (PLEG): container finished" podID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerID="66694d29882c3e1c7193e306338f7938336c59c7fb994bcdb849c344b22dfa3d" exitCode=0 Sep 08 02:26:14.857300 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.857271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" event={"ID":"84c49f2f-6d07-47e6-9336-e8fd9fb61f23","Type":"ContainerDied","Data":"66694d29882c3e1c7193e306338f7938336c59c7fb994bcdb849c344b22dfa3d"} Sep 08 02:26:14.857366 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.857313 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" event={"ID":"84c49f2f-6d07-47e6-9336-e8fd9fb61f23","Type":"ContainerStarted","Data":"343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183"} Sep 08 02:26:14.861654 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.861621 2581 generic.go:356] "Generic (PLEG): container finished" podID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerID="f06cf7e4d97ecf1ec42780aa463459d647ce6132b82016ad7f11f55bbc362294" exitCode=0 Sep 08 02:26:14.861738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.861694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" event={"ID":"269f5f40-b6e1-43b3-a156-8773bf4f66ff","Type":"ContainerDied","Data":"f06cf7e4d97ecf1ec42780aa463459d647ce6132b82016ad7f11f55bbc362294"} Sep 08 02:26:14.861738 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.861732 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" event={"ID":"269f5f40-b6e1-43b3-a156-8773bf4f66ff","Type":"ContainerStarted","Data":"5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02"} Sep 08 02:26:14.864395 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.864368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" event={"ID":"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b","Type":"ContainerStarted","Data":"72b5415a7bd32a049d5cc3c389f1083197bdb9fcced02936aea180fea1a4fff6"} Sep 08 02:26:14.868162 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.868117 2581 generic.go:356] "Generic (PLEG): container finished" podID="daff855a-afef-45ab-929d-afdce700d0e0" containerID="368cbfb0de1b7f3f3822842d183bd90216f2951b6f92978a7a9cb05f8ff33c73" exitCode=0 Sep 08 02:26:14.868309 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.868288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" event={"ID":"daff855a-afef-45ab-929d-afdce700d0e0","Type":"ContainerDied","Data":"368cbfb0de1b7f3f3822842d183bd90216f2951b6f92978a7a9cb05f8ff33c73"} Sep 08 02:26:14.868367 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.868335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" event={"ID":"daff855a-afef-45ab-929d-afdce700d0e0","Type":"ContainerStarted","Data":"36b55a1b4d3e3282656b1a1a0026da87d1cb4413458f32fa1bc85dbcc8a43488"} Sep 08 02:26:14.872121 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.871527 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerID="a78fb299df8c6f30a77bbab9fc9e926efea8b54c29bb43d4e8d038a885e9686d" exitCode=0 Sep 08 02:26:14.872121 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:14.871564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" event={"ID":"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6","Type":"ContainerDied","Data":"a78fb299df8c6f30a77bbab9fc9e926efea8b54c29bb43d4e8d038a885e9686d"} Sep 08 02:26:16.452920 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.452866 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.453254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.452866 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.453254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.452985 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.453254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.453026 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.453254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.453029 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.453254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.453069 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.476328 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.476292 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.476444 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.476363 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.476444 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.476405 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.534507 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.534464 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.534635 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.534568 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.534709 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.534642 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:26:16.887165 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.886419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" event={"ID":"d8892594-f8b3-49f9-b41a-78cc662c6b4f","Type":"ContainerStarted","Data":"93312626c0b5b63345ec31a1d2e2dcea29e045d1bba7aef1a0ef4437302dd37c"} Sep 08 02:26:16.892358 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.892190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" event={"ID":"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b","Type":"ContainerStarted","Data":"e2e1c27e9f9d8e6d092e12a2e93eb3fbee56fa51ac8365bdab6cf482cfcd1bfe"} Sep 08 02:26:16.896744 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.896575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" event={"ID":"cdd566e7-745a-49d3-821b-147d5408932e","Type":"ContainerStarted","Data":"6df0d92fd4648c32dcab533589a95b1c0f1726d09e62868367b25074e3de8173"} Sep 08 02:26:16.900546 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.900501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" event={"ID":"d2de3cdc-c19e-4371-86a8-d9f58900bbc7","Type":"ContainerStarted","Data":"174c19add80b78acbb212e65c16a499555b76ac4d8629a93085b491fa376fbc8"} Sep 08 02:26:16.910635 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.910580 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" podStartSLOduration=1.1556889240000001 podStartE2EDuration="5.910560178s" totalImagesPullingTime="4.754871254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:16.908530168 +0000 UTC m=+327.772737278" watchObservedRunningTime="2026-09-08 02:26:16.910560178 +0000 UTC m=+327.774767289" Sep 08 02:26:16.935761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.934783 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" podStartSLOduration=2.102380176 podStartE2EDuration="6.934756276s" totalImagesPullingTime="4.8323761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:16.933749786 +0000 UTC m=+327.797956897" watchObservedRunningTime="2026-09-08 02:26:16.934756276 +0000 UTC m=+327.798963386" Sep 08 02:26:16.956420 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:16.956199 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" podStartSLOduration=3.142537961 podStartE2EDuration="5.956186935s" totalImagesPullingTime="2.813648974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:16.955427074 +0000 UTC m=+327.819634217" watchObservedRunningTime="2026-09-08 02:26:16.956186935 +0000 UTC m=+327.820394045" Sep 08 02:26:17.330479 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.330437 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:17.331921 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.331889 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" start-of-body= Sep 08 02:26:17.332047 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.331950 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" Sep 08 02:26:17.407284 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.407250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:17.408864 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.408831 2581 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" start-of-body= Sep 08 02:26:17.408988 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.408881 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" Sep 08 02:26:17.597298 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.597259 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:17.603062 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.603033 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:17.626098 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.626051 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podStartSLOduration=4.069581945 podStartE2EDuration="6.626033193s" totalImagesPullingTime="2.556451248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:16.975947072 +0000 UTC m=+327.840154183" watchObservedRunningTime="2026-09-08 02:26:17.626033193 +0000 UTC m=+328.490240336" Sep 08 02:26:17.828063 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.827986 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:17.833554 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.833472 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:17.906535 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.906496 2581 generic.go:356] "Generic (PLEG): container finished" podID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerID="e73292c7a39669db9e05ac7b9b75633d7c733749176c88b0117dc3e1a7ae4d22" exitCode=0 Sep 08 02:26:17.906700 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.906576 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" event={"ID":"579d4414-9e8d-4c18-823e-c7a6c96141af","Type":"ContainerDied","Data":"e73292c7a39669db9e05ac7b9b75633d7c733749176c88b0117dc3e1a7ae4d22"} Sep 08 02:26:17.908691 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.908669 2581 generic.go:356] "Generic (PLEG): container finished" podID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerID="8417ede610817b2631aea37f0fa1ba3173bf9ee47ac4165a9df7c798858d8383" exitCode=0 Sep 08 02:26:17.908822 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.908738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" event={"ID":"84c49f2f-6d07-47e6-9336-e8fd9fb61f23","Type":"ContainerDied","Data":"8417ede610817b2631aea37f0fa1ba3173bf9ee47ac4165a9df7c798858d8383"} Sep 08 02:26:17.910850 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.910818 2581 generic.go:356] "Generic (PLEG): container finished" podID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerID="ee8aab8dc5260af444ab2b8ef68be77aa3db17e3c9449a4a5cda492721001e6c" exitCode=0 Sep 08 02:26:17.910953 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.910865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" event={"ID":"269f5f40-b6e1-43b3-a156-8773bf4f66ff","Type":"ContainerDied","Data":"ee8aab8dc5260af444ab2b8ef68be77aa3db17e3c9449a4a5cda492721001e6c"} Sep 08 02:26:17.913451 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.913387 2581 generic.go:356] "Generic (PLEG): container finished" podID="daff855a-afef-45ab-929d-afdce700d0e0" containerID="7ce30f58291f4696d2d0a0043dc425d2b2e23128e50acc22e940593d0f353007" exitCode=0 Sep 08 02:26:17.913516 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.913501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" event={"ID":"daff855a-afef-45ab-929d-afdce700d0e0","Type":"ContainerDied","Data":"7ce30f58291f4696d2d0a0043dc425d2b2e23128e50acc22e940593d0f353007"} Sep 08 02:26:17.914431 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.914000 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:17.914431 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.914041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:17.915080 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.915058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:26:17.915203 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.915123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np" Sep 08 02:26:17.988266 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.988228 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:17.997132 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:17.997107 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:18.331095 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.331060 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" start-of-body= Sep 08 02:26:18.331285 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.331157 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" Sep 08 02:26:18.407987 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.407947 2581 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" start-of-body= Sep 08 02:26:18.408179 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.408059 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" Sep 08 02:26:18.924699 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.924479 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerID="ff81c7c9b462952ad37a7a0adc6fefd337ad334fdbfb224d08fadde4ca0d3e8b" exitCode=0 Sep 08 02:26:18.927184 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:18.925820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" event={"ID":"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6","Type":"ContainerDied","Data":"ff81c7c9b462952ad37a7a0adc6fefd337ad334fdbfb224d08fadde4ca0d3e8b"} Sep 08 02:26:19.331176 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.330823 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" start-of-body= Sep 08 02:26:19.331176 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.330918 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.15:15021/healthz/ready\": dial tcp 10.132.0.15:15021: connect: connection refused" Sep 08 02:26:19.408400 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.407892 2581 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" start-of-body= Sep 08 02:26:19.408400 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.407964 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" Sep 08 02:26:19.932022 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.931982 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" containerID="cri-o://93312626c0b5b63345ec31a1d2e2dcea29e045d1bba7aef1a0ef4437302dd37c" gracePeriod=30 Sep 08 02:26:19.932514 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:19.932296 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" containerID="cri-o://174c19add80b78acbb212e65c16a499555b76ac4d8629a93085b491fa376fbc8" gracePeriod=30 Sep 08 02:26:26.330303 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.330266 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:26.406788 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.406746 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:26.979998 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.979967 2581 generic.go:356] "Generic (PLEG): container finished" podID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerID="174c19add80b78acbb212e65c16a499555b76ac4d8629a93085b491fa376fbc8" exitCode=0 Sep 08 02:26:26.980164 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.980048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" event={"ID":"d2de3cdc-c19e-4371-86a8-d9f58900bbc7","Type":"ContainerDied","Data":"174c19add80b78acbb212e65c16a499555b76ac4d8629a93085b491fa376fbc8"} Sep 08 02:26:26.982292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.982203 2581 generic.go:356] "Generic (PLEG): container finished" podID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerID="93312626c0b5b63345ec31a1d2e2dcea29e045d1bba7aef1a0ef4437302dd37c" exitCode=0 Sep 08 02:26:26.982292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:26.982256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" event={"ID":"d8892594-f8b3-49f9-b41a-78cc662c6b4f","Type":"ContainerDied","Data":"93312626c0b5b63345ec31a1d2e2dcea29e045d1bba7aef1a0ef4437302dd37c"} Sep 08 02:26:27.065317 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.065292 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:27.081309 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.081289 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121262 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121334 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121363 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db9ms\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121395 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121421 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121451 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121486 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121521 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121548 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szmt2\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121609 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121606 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121640 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121667 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121703 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121728 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121802 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket\") pod \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\" (UID: \"d2de3cdc-c19e-4371-86a8-d9f58900bbc7\") " Sep 08 02:26:27.122311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121830 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy\") pod \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\" (UID: \"d8892594-f8b3-49f9-b41a-78cc662c6b4f\") " Sep 08 02:26:27.123289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.121971 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:26:27.123289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.122094 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.123289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.122111 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.123289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123023 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.123289 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123227 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.123618 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123333 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.123618 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123362 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.123618 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123546 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 02:26:27.123825 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.123801 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.124128 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.124103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.126423 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.126395 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:27.126527 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.126506 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.126909 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.126876 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:27.127220 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.127190 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.127684 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.127641 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 08 02:26:27.127765 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.127705 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2" (OuterVolumeSpecName: "kube-api-access-szmt2") pod "d2de3cdc-c19e-4371-86a8-d9f58900bbc7" (UID: "d2de3cdc-c19e-4371-86a8-d9f58900bbc7"). InnerVolumeSpecName "kube-api-access-szmt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:27.127979 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.127952 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 08 02:26:27.128733 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.128674 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms" (OuterVolumeSpecName: "kube-api-access-db9ms") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "kube-api-access-db9ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:27.130507 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.130474 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8892594-f8b3-49f9-b41a-78cc662c6b4f" (UID: "d8892594-f8b3-49f9-b41a-78cc662c6b4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222799 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222832 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222846 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222861 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222873 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222887 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222899 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db9ms\" (UniqueName: \"kubernetes.io/projected/d8892594-f8b3-49f9-b41a-78cc662c6b4f-kube-api-access-db9ms\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222911 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222923 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222936 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222964 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222978 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szmt2\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-kube-api-access-szmt2\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.222980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.222990 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.223744 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.223033 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.223744 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.223047 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8892594-f8b3-49f9-b41a-78cc662c6b4f-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.223744 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.223059 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2de3cdc-c19e-4371-86a8-d9f58900bbc7-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:27.988929 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.988843 2581 generic.go:356] "Generic (PLEG): container finished" podID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerID="cb5dd29e42b3892643bc28dc20efa971ed0934f0f255ec32051b4dbfdc4d2c9f" exitCode=0 Sep 08 02:26:27.989346 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.988928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" event={"ID":"269f5f40-b6e1-43b3-a156-8773bf4f66ff","Type":"ContainerDied","Data":"cb5dd29e42b3892643bc28dc20efa971ed0934f0f255ec32051b4dbfdc4d2c9f"} Sep 08 02:26:27.990969 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.990942 2581 generic.go:356] "Generic (PLEG): container finished" podID="daff855a-afef-45ab-929d-afdce700d0e0" containerID="e96e10087efbe0b17da69873a1536db5b60f5e79bb09db750b25cd2687ddb4a6" exitCode=0 Sep 08 02:26:27.991071 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.991017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" event={"ID":"daff855a-afef-45ab-929d-afdce700d0e0","Type":"ContainerDied","Data":"e96e10087efbe0b17da69873a1536db5b60f5e79bb09db750b25cd2687ddb4a6"} Sep 08 02:26:27.992278 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.992264 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" Sep 08 02:26:27.992360 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.992278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm" event={"ID":"d2de3cdc-c19e-4371-86a8-d9f58900bbc7","Type":"ContainerDied","Data":"cf45a46846b7c2dc6244795be34fd98eed5b36c86ee8f2f9e07b0598f4966d4e"} Sep 08 02:26:27.992360 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.992315 2581 scope.go:117] "RemoveContainer" containerID="174c19add80b78acbb212e65c16a499555b76ac4d8629a93085b491fa376fbc8" Sep 08 02:26:27.994968 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.994948 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerID="790c5e1c322fc8eafc480144690431a72d83ca3bcf3ad1d67b883154b3de3436" exitCode=0 Sep 08 02:26:27.995087 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.995026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" event={"ID":"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6","Type":"ContainerDied","Data":"790c5e1c322fc8eafc480144690431a72d83ca3bcf3ad1d67b883154b3de3436"} Sep 08 02:26:27.996406 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.996386 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" Sep 08 02:26:27.996502 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.996392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665" event={"ID":"d8892594-f8b3-49f9-b41a-78cc662c6b4f","Type":"ContainerDied","Data":"9681a302f3eb453a29d8758dc64276948876bf3705ab304dc9f338a822f48678"} Sep 08 02:26:27.998583 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.998561 2581 generic.go:356] "Generic (PLEG): container finished" podID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerID="c49042d4a9631bf888baaf5ba7676f766338c49a58c6ccb4a9de752d166f121a" exitCode=0 Sep 08 02:26:27.998724 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:27.998641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" event={"ID":"579d4414-9e8d-4c18-823e-c7a6c96141af","Type":"ContainerDied","Data":"c49042d4a9631bf888baaf5ba7676f766338c49a58c6ccb4a9de752d166f121a"} Sep 08 02:26:28.000739 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.000720 2581 generic.go:356] "Generic (PLEG): container finished" podID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerID="d1b844a35135aedbe26c0464af256205aff7d2410cfc1095bb794243e7324189" exitCode=0 Sep 08 02:26:28.000846 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.000753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" event={"ID":"84c49f2f-6d07-47e6-9336-e8fd9fb61f23","Type":"ContainerDied","Data":"d1b844a35135aedbe26c0464af256205aff7d2410cfc1095bb794243e7324189"} Sep 08 02:26:28.002626 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.002611 2581 scope.go:117] "RemoveContainer" containerID="93312626c0b5b63345ec31a1d2e2dcea29e045d1bba7aef1a0ef4437302dd37c" Sep 08 02:26:28.071702 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.071672 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:28.082835 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.082802 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-p9jxm"] Sep 08 02:26:28.104919 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.104896 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:28.117542 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:28.117515 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-v9665"] Sep 08 02:26:29.150299 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.150127 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:29.180129 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.180103 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:29.210514 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.210317 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:29.215223 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.215194 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:29.222133 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.222115 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:29.240362 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240338 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util\") pod \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " Sep 08 02:26:29.240487 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240368 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util\") pod \"579d4414-9e8d-4c18-823e-c7a6c96141af\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " Sep 08 02:26:29.240487 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240393 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util\") pod \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " Sep 08 02:26:29.240487 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240424 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util\") pod \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " Sep 08 02:26:29.240487 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle\") pod \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240507 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54jtg\" (UniqueName: \"kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg\") pod \"579d4414-9e8d-4c18-823e-c7a6c96141af\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240542 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbmwc\" (UniqueName: \"kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc\") pod \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240573 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sz2q\" (UniqueName: \"kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q\") pod \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240609 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bl99\" (UniqueName: \"kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99\") pod \"daff855a-afef-45ab-929d-afdce700d0e0\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240646 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc\") pod \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\" (UID: \"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle\") pod \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\" (UID: \"269f5f40-b6e1-43b3-a156-8773bf4f66ff\") " Sep 08 02:26:29.240711 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240708 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util\") pod \"daff855a-afef-45ab-929d-afdce700d0e0\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " Sep 08 02:26:29.241052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240734 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle\") pod \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\" (UID: \"84c49f2f-6d07-47e6-9336-e8fd9fb61f23\") " Sep 08 02:26:29.241052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240757 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle\") pod \"daff855a-afef-45ab-929d-afdce700d0e0\" (UID: \"daff855a-afef-45ab-929d-afdce700d0e0\") " Sep 08 02:26:29.241052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.240810 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle\") pod \"579d4414-9e8d-4c18-823e-c7a6c96141af\" (UID: \"579d4414-9e8d-4c18-823e-c7a6c96141af\") " Sep 08 02:26:29.242109 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.241663 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle" (OuterVolumeSpecName: "bundle") pod "579d4414-9e8d-4c18-823e-c7a6c96141af" (UID: "579d4414-9e8d-4c18-823e-c7a6c96141af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.242305 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.242278 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle" (OuterVolumeSpecName: "bundle") pod "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" (UID: "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.242900 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.242874 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle" (OuterVolumeSpecName: "bundle") pod "84c49f2f-6d07-47e6-9336-e8fd9fb61f23" (UID: "84c49f2f-6d07-47e6-9336-e8fd9fb61f23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.244196 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.244172 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle" (OuterVolumeSpecName: "bundle") pod "daff855a-afef-45ab-929d-afdce700d0e0" (UID: "daff855a-afef-45ab-929d-afdce700d0e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.244877 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.244848 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc" (OuterVolumeSpecName: "kube-api-access-pbmwc") pod "84c49f2f-6d07-47e6-9336-e8fd9fb61f23" (UID: "84c49f2f-6d07-47e6-9336-e8fd9fb61f23"). InnerVolumeSpecName "kube-api-access-pbmwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:29.246806 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.246776 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle" (OuterVolumeSpecName: "bundle") pod "269f5f40-b6e1-43b3-a156-8773bf4f66ff" (UID: "269f5f40-b6e1-43b3-a156-8773bf4f66ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.248068 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.248041 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util" (OuterVolumeSpecName: "util") pod "269f5f40-b6e1-43b3-a156-8773bf4f66ff" (UID: "269f5f40-b6e1-43b3-a156-8773bf4f66ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.248509 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.248486 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util" (OuterVolumeSpecName: "util") pod "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" (UID: "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.249042 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.249015 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util" (OuterVolumeSpecName: "util") pod "579d4414-9e8d-4c18-823e-c7a6c96141af" (UID: "579d4414-9e8d-4c18-823e-c7a6c96141af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.249351 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.249323 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util" (OuterVolumeSpecName: "util") pod "84c49f2f-6d07-47e6-9336-e8fd9fb61f23" (UID: "84c49f2f-6d07-47e6-9336-e8fd9fb61f23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.249442 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.249379 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q" (OuterVolumeSpecName: "kube-api-access-2sz2q") pod "269f5f40-b6e1-43b3-a156-8773bf4f66ff" (UID: "269f5f40-b6e1-43b3-a156-8773bf4f66ff"). InnerVolumeSpecName "kube-api-access-2sz2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:29.249442 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.249407 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg" (OuterVolumeSpecName: "kube-api-access-54jtg") pod "579d4414-9e8d-4c18-823e-c7a6c96141af" (UID: "579d4414-9e8d-4c18-823e-c7a6c96141af"). InnerVolumeSpecName "kube-api-access-54jtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:29.249892 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.249863 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc" (OuterVolumeSpecName: "kube-api-access-jj2kc") pod "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" (UID: "5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6"). InnerVolumeSpecName "kube-api-access-jj2kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:29.250720 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.250687 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99" (OuterVolumeSpecName: "kube-api-access-8bl99") pod "daff855a-afef-45ab-929d-afdce700d0e0" (UID: "daff855a-afef-45ab-929d-afdce700d0e0"). InnerVolumeSpecName "kube-api-access-8bl99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:26:29.251294 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.251268 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util" (OuterVolumeSpecName: "util") pod "daff855a-afef-45ab-929d-afdce700d0e0" (UID: "daff855a-afef-45ab-929d-afdce700d0e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 02:26:29.342126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342091 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-bundle\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342121 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54jtg\" (UniqueName: \"kubernetes.io/projected/579d4414-9e8d-4c18-823e-c7a6c96141af-kube-api-access-54jtg\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342132 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbmwc\" (UniqueName: \"kubernetes.io/projected/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-kube-api-access-pbmwc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342164 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sz2q\" (UniqueName: \"kubernetes.io/projected/269f5f40-b6e1-43b3-a156-8773bf4f66ff-kube-api-access-2sz2q\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342174 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bl99\" (UniqueName: \"kubernetes.io/projected/daff855a-afef-45ab-929d-afdce700d0e0-kube-api-access-8bl99\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342183 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-kube-api-access-jj2kc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342191 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-bundle\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342200 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-util\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342208 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-bundle\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342215 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daff855a-afef-45ab-929d-afdce700d0e0-bundle\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342223 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-bundle\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342231 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/269f5f40-b6e1-43b3-a156-8773bf4f66ff-util\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342238 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579d4414-9e8d-4c18-823e-c7a6c96141af-util\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342246 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6-util\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.342430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.342252 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84c49f2f-6d07-47e6-9336-e8fd9fb61f23-util\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:26:29.664499 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.664400 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" path="/var/lib/kubelet/pods/d2de3cdc-c19e-4371-86a8-d9f58900bbc7/volumes" Sep 08 02:26:29.664919 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.664897 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" path="/var/lib/kubelet/pods/d8892594-f8b3-49f9-b41a-78cc662c6b4f/volumes" Sep 08 02:26:29.763891 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.763857 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv"] Sep 08 02:26:29.764129 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764116 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="pull" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764130 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="pull" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764151 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="pull" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764157 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="pull" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764164 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="extract" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764170 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="extract" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764177 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="extract" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764182 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="extract" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764190 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764195 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764203 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" Sep 08 02:26:29.764207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764208 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764215 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764220 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764229 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764233 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764239 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764244 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764249 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764255 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764261 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764266 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764274 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764278 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764284 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764289 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764296 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764300 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764306 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764312 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764319 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764325 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="util" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764333 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764337 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="pull" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764380 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764389 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="269f5f40-b6e1-43b3-a156-8773bf4f66ff" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764397 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="579d4414-9e8d-4c18-823e-c7a6c96141af" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764409 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c49f2f-6d07-47e6-9336-e8fd9fb61f23" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764414 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2de3cdc-c19e-4371-86a8-d9f58900bbc7" containerName="istio-proxy" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764422 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="daff855a-afef-45ab-929d-afdce700d0e0" containerName="extract" Sep 08 02:26:29.764504 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.764428 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8892594-f8b3-49f9-b41a-78cc662c6b4f" containerName="istio-proxy" Sep 08 02:26:29.771530 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.771507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.775057 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.775032 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 08 02:26:29.775173 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.775126 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qq5tc\"" Sep 08 02:26:29.776235 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.776218 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:26:29.781533 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.781513 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv"] Sep 08 02:26:29.846623 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.846591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a218839b-7c37-4af9-8150-7c71537a932c-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.846786 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.846628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqcj5\" (UniqueName: \"kubernetes.io/projected/a218839b-7c37-4af9-8150-7c71537a932c-kube-api-access-xqcj5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.947767 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.947686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqcj5\" (UniqueName: \"kubernetes.io/projected/a218839b-7c37-4af9-8150-7c71537a932c-kube-api-access-xqcj5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.947904 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.947845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a218839b-7c37-4af9-8150-7c71537a932c-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.948194 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.948179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a218839b-7c37-4af9-8150-7c71537a932c-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:29.956645 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:29.956625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqcj5\" (UniqueName: \"kubernetes.io/projected/a218839b-7c37-4af9-8150-7c71537a932c-kube-api-access-xqcj5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-4swbv\" (UID: \"a218839b-7c37-4af9-8150-7c71537a932c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:30.012886 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.012860 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" Sep 08 02:26:30.013040 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.012853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bblgkfm" event={"ID":"269f5f40-b6e1-43b3-a156-8773bf4f66ff","Type":"ContainerDied","Data":"5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02"} Sep 08 02:26:30.013040 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.012981 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b5abdec8036fa8809cee1a51a4cffdebd90ed2bf66abaccc311f9bf1aa09d02" Sep 08 02:26:30.015084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.014904 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" Sep 08 02:26:30.015084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.014908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6jns7" event={"ID":"daff855a-afef-45ab-929d-afdce700d0e0","Type":"ContainerDied","Data":"36b55a1b4d3e3282656b1a1a0026da87d1cb4413458f32fa1bc85dbcc8a43488"} Sep 08 02:26:30.015084 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.014963 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36b55a1b4d3e3282656b1a1a0026da87d1cb4413458f32fa1bc85dbcc8a43488" Sep 08 02:26:30.017357 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.017335 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" Sep 08 02:26:30.017474 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.017351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ekhxch" event={"ID":"5d70fb0b-9ca1-4c89-aa00-3b5fa9da04a6","Type":"ContainerDied","Data":"d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f"} Sep 08 02:26:30.017474 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.017391 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d99fc9c80d490196e848165ca14ce19612a46f60b6c2c24abad4381d5757155f" Sep 08 02:26:30.019252 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.019232 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" Sep 08 02:26:30.019369 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.019231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053kw4xj" event={"ID":"579d4414-9e8d-4c18-823e-c7a6c96141af","Type":"ContainerDied","Data":"c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9"} Sep 08 02:26:30.019440 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.019368 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4e9254442a3ea634e4895efaac3d02d6902449ad449dc589d498ef08b4d88a9" Sep 08 02:26:30.021420 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.021401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" event={"ID":"84c49f2f-6d07-47e6-9336-e8fd9fb61f23","Type":"ContainerDied","Data":"343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183"} Sep 08 02:26:30.021513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.021432 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="343b336e33c6e48f5a0e9bfae2bb0f9476dda042653daa9713f175aa7b516183" Sep 08 02:26:30.021513 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.021493 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08szkr" Sep 08 02:26:30.080379 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.080348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" Sep 08 02:26:30.381168 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:30.381107 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv"] Sep 08 02:26:30.383812 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:30.383776 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda218839b_7c37_4af9_8150_7c71537a932c.slice/crio-d07cfa7bbbffad77b79543c926ec02d49f0617835a6fa4ce2ef5f42ee1286891 WatchSource:0}: Error finding container d07cfa7bbbffad77b79543c926ec02d49f0617835a6fa4ce2ef5f42ee1286891: Status 404 returned error can't find the container with id d07cfa7bbbffad77b79543c926ec02d49f0617835a6fa4ce2ef5f42ee1286891 Sep 08 02:26:31.027115 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:31.027075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" event={"ID":"a218839b-7c37-4af9-8150-7c71537a932c","Type":"ContainerStarted","Data":"d07cfa7bbbffad77b79543c926ec02d49f0617835a6fa4ce2ef5f42ee1286891"} Sep 08 02:26:34.044463 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:34.044424 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" event={"ID":"a218839b-7c37-4af9-8150-7c71537a932c","Type":"ContainerStarted","Data":"7165849b3159d7e6cbbc9b0bebad60ca0d86db720577d21597ed35d849609c69"} Sep 08 02:26:34.083597 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:34.083540 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-4swbv" podStartSLOduration=1.9184912490000001 podStartE2EDuration="5.083523491s" totalImagesPullingTime="3.165032242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:34.081230566 +0000 UTC m=+344.945437668" watchObservedRunningTime="2026-09-08 02:26:34.083523491 +0000 UTC m=+344.947730600" Sep 08 02:26:35.288832 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.288795 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5"] Sep 08 02:26:35.291889 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.291872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.295037 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.295013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 08 02:26:35.300070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.296274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 08 02:26:35.300070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.296550 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 08 02:26:35.300070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.296784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-58nrg\"" Sep 08 02:26:35.300070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.297040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 02:26:35.300070 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.297288 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 08 02:26:35.309841 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.309815 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5"] Sep 08 02:26:35.392965 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.392931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-tmp\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.392965 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.392967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.393202 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.393038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjl69\" (UniqueName: \"kubernetes.io/projected/ced6cd71-1f4e-4dff-b337-07a471ce5383-kube-api-access-wjl69\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.393202 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.393079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.393202 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.393115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.393202 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.393178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-manifests\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494413 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-tmp\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494413 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494654 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjl69\" (UniqueName: \"kubernetes.io/projected/ced6cd71-1f4e-4dff-b337-07a471ce5383-kube-api-access-wjl69\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494654 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494654 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494654 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-manifests\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.494959 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.494934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-manifests\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.496828 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.496799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6cd71-1f4e-4dff-b337-07a471ce5383-tmp\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.496934 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.496898 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.496999 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.496972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.497125 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.497104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6cd71-1f4e-4dff-b337-07a471ce5383-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.509708 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.509682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjl69\" (UniqueName: \"kubernetes.io/projected/ced6cd71-1f4e-4dff-b337-07a471ce5383-kube-api-access-wjl69\") pod \"opendatahub-operator-controller-manager-5c89fb8b78-fz5p5\" (UID: \"ced6cd71-1f4e-4dff-b337-07a471ce5383\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.607000 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.606958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:35.892256 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:35.892227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5"] Sep 08 02:26:35.893698 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:35.893672 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced6cd71_1f4e_4dff_b337_07a471ce5383.slice/crio-52bc36e55fa441f0d15e30e3ee7e7adc18595819213baac4fe2104cd4c336ac9 WatchSource:0}: Error finding container 52bc36e55fa441f0d15e30e3ee7e7adc18595819213baac4fe2104cd4c336ac9: Status 404 returned error can't find the container with id 52bc36e55fa441f0d15e30e3ee7e7adc18595819213baac4fe2104cd4c336ac9 Sep 08 02:26:36.055478 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:36.055443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" event={"ID":"ced6cd71-1f4e-4dff-b337-07a471ce5383","Type":"ContainerStarted","Data":"52bc36e55fa441f0d15e30e3ee7e7adc18595819213baac4fe2104cd4c336ac9"} Sep 08 02:26:38.818578 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.818536 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l"] Sep 08 02:26:38.823204 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.823186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:38.825726 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.825701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 08 02:26:38.825980 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.825966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 08 02:26:38.826704 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.826682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-9tdtd\"" Sep 08 02:26:38.832512 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.832488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l"] Sep 08 02:26:38.921882 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.921850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41d342-d644-4225-a03a-a117548dee33-tmp\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:38.922080 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:38.921920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpgn\" (UniqueName: \"kubernetes.io/projected/8f41d342-d644-4225-a03a-a117548dee33-kube-api-access-hwpgn\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.022909 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.022827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpgn\" (UniqueName: \"kubernetes.io/projected/8f41d342-d644-4225-a03a-a117548dee33-kube-api-access-hwpgn\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.022909 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.022903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41d342-d644-4225-a03a-a117548dee33-tmp\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.069527 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.069495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f41d342-d644-4225-a03a-a117548dee33-tmp\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.071954 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.071932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpgn\" (UniqueName: \"kubernetes.io/projected/8f41d342-d644-4225-a03a-a117548dee33-kube-api-access-hwpgn\") pod \"jobset-operator-56d489b4b8-g4q5l\" (UID: \"8f41d342-d644-4225-a03a-a117548dee33\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.072184 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.072163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" event={"ID":"ced6cd71-1f4e-4dff-b337-07a471ce5383","Type":"ContainerStarted","Data":"acce7765ba3e8f41aad27172d006aea7e804dca31e49e47772e43ffe3d58af26"} Sep 08 02:26:39.132166 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.132124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" Sep 08 02:26:39.425170 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:39.425131 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l"] Sep 08 02:26:39.426975 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:39.426952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f41d342_d644_4225_a03a_a117548dee33.slice/crio-89084163823bb5bdf573cb83c29e48cbf07ea76692e51d5c60ba1bdace2be2c1 WatchSource:0}: Error finding container 89084163823bb5bdf573cb83c29e48cbf07ea76692e51d5c60ba1bdace2be2c1: Status 404 returned error can't find the container with id 89084163823bb5bdf573cb83c29e48cbf07ea76692e51d5c60ba1bdace2be2c1 Sep 08 02:26:40.079039 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:40.079000 2581 generic.go:356] "Generic (PLEG): container finished" podID="ced6cd71-1f4e-4dff-b337-07a471ce5383" containerID="acce7765ba3e8f41aad27172d006aea7e804dca31e49e47772e43ffe3d58af26" exitCode=0 Sep 08 02:26:40.079520 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:40.079101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" event={"ID":"ced6cd71-1f4e-4dff-b337-07a471ce5383","Type":"ContainerDied","Data":"acce7765ba3e8f41aad27172d006aea7e804dca31e49e47772e43ffe3d58af26"} Sep 08 02:26:40.080790 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:40.080764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" event={"ID":"8f41d342-d644-4225-a03a-a117548dee33","Type":"ContainerStarted","Data":"89084163823bb5bdf573cb83c29e48cbf07ea76692e51d5c60ba1bdace2be2c1"} Sep 08 02:26:41.089154 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:41.089104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" event={"ID":"ced6cd71-1f4e-4dff-b337-07a471ce5383","Type":"ContainerStarted","Data":"7f5751d02a674795a88c3051b2d02b6c37c8c6e2effaf8493088fc02c84965ed"} Sep 08 02:26:41.089610 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:41.089274 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:41.146812 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:41.146751 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" podStartSLOduration=2.562094972 podStartE2EDuration="6.146727738s" totalImagesPullingTime="3.177346576s" totalInitContainerRuntime="407.28619ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:41.145861534 +0000 UTC m=+352.010068681" watchObservedRunningTime="2026-09-08 02:26:41.146727738 +0000 UTC m=+352.010934849" Sep 08 02:26:42.095602 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:42.095508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" event={"ID":"8f41d342-d644-4225-a03a-a117548dee33","Type":"ContainerStarted","Data":"f3dd339cc41f879e53126281c6262c97efd0d32887eae56148bda81ba2d2b196"} Sep 08 02:26:42.117658 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:42.117607 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-g4q5l" podStartSLOduration=2.3258506629999998 podStartE2EDuration="4.117589789s" totalImagesPullingTime="1.791739126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:42.116993292 +0000 UTC m=+352.981200402" watchObservedRunningTime="2026-09-08 02:26:42.117589789 +0000 UTC m=+352.981796898" Sep 08 02:26:44.888312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.888278 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cz6jc"] Sep 08 02:26:44.893645 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.893620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:44.896424 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.896403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 08 02:26:44.896547 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.896440 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 08 02:26:44.896547 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.896536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vcctq\"" Sep 08 02:26:44.908427 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.908402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cz6jc"] Sep 08 02:26:44.976048 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.976002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:44.976254 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:44.976087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97b8\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-kube-api-access-k97b8\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.077311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.077272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97b8\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-kube-api-access-k97b8\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.077475 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.077338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.087768 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.087733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-bound-sa-token\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.087888 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.087799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97b8\" (UniqueName: \"kubernetes.io/projected/89a7c3a6-b315-4035-9c54-5a9ea00d92eb-kube-api-access-k97b8\") pod \"cert-manager-55b4d954d5-cz6jc\" (UID: \"89a7c3a6-b315-4035-9c54-5a9ea00d92eb\") " pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.202896 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.202814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cz6jc" Sep 08 02:26:45.473438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:45.473413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cz6jc"] Sep 08 02:26:45.475594 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:45.475558 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89a7c3a6_b315_4035_9c54_5a9ea00d92eb.slice/crio-9515c07801ae60484c8248c1c9545db7fe6e37241cf45a9522f951b320b83c47 WatchSource:0}: Error finding container 9515c07801ae60484c8248c1c9545db7fe6e37241cf45a9522f951b320b83c47: Status 404 returned error can't find the container with id 9515c07801ae60484c8248c1c9545db7fe6e37241cf45a9522f951b320b83c47 Sep 08 02:26:46.115746 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:46.115711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cz6jc" event={"ID":"89a7c3a6-b315-4035-9c54-5a9ea00d92eb","Type":"ContainerStarted","Data":"9515c07801ae60484c8248c1c9545db7fe6e37241cf45a9522f951b320b83c47"} Sep 08 02:26:48.126704 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:48.126663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cz6jc" event={"ID":"89a7c3a6-b315-4035-9c54-5a9ea00d92eb","Type":"ContainerStarted","Data":"7320c8730426f2947fc21058f7adc6ebc528da1ffa38c65f39f20b9e1ebfb699"} Sep 08 02:26:48.149726 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:48.149676 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cz6jc" podStartSLOduration=1.631575845 podStartE2EDuration="4.149658647s" totalImagesPullingTime="2.518082802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:48.147713982 +0000 UTC m=+359.011921093" watchObservedRunningTime="2026-09-08 02:26:48.149658647 +0000 UTC m=+359.013865757" Sep 08 02:26:50.750033 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.749993 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z"] Sep 08 02:26:50.754701 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.754680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:50.758329 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.758307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 08 02:26:50.759201 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.759183 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rkn6b\"" Sep 08 02:26:50.759288 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.759244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 08 02:26:50.763913 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.763891 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z"] Sep 08 02:26:50.825386 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.825349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjsw8\" (UniqueName: \"kubernetes.io/projected/55c384d0-1090-444c-a9c4-fc25451c78d4-kube-api-access-zjsw8\") pod \"limitador-operator-controller-manager-565895c755-ktq7z\" (UID: \"55c384d0-1090-444c-a9c4-fc25451c78d4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:50.926793 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.926753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjsw8\" (UniqueName: \"kubernetes.io/projected/55c384d0-1090-444c-a9c4-fc25451c78d4-kube-api-access-zjsw8\") pod \"limitador-operator-controller-manager-565895c755-ktq7z\" (UID: \"55c384d0-1090-444c-a9c4-fc25451c78d4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:50.937163 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:50.937107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjsw8\" (UniqueName: \"kubernetes.io/projected/55c384d0-1090-444c-a9c4-fc25451c78d4-kube-api-access-zjsw8\") pod \"limitador-operator-controller-manager-565895c755-ktq7z\" (UID: \"55c384d0-1090-444c-a9c4-fc25451c78d4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:51.065286 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:51.065254 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:51.342220 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:51.342193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z"] Sep 08 02:26:51.344312 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:51.344284 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c384d0_1090_444c_a9c4_fc25451c78d4.slice/crio-550b7739dda65da168be5c1b2f59c2616e83db93ce295954e3a652ad2d8fad44 WatchSource:0}: Error finding container 550b7739dda65da168be5c1b2f59c2616e83db93ce295954e3a652ad2d8fad44: Status 404 returned error can't find the container with id 550b7739dda65da168be5c1b2f59c2616e83db93ce295954e3a652ad2d8fad44 Sep 08 02:26:52.098394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:52.098361 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c89fb8b78-fz5p5" Sep 08 02:26:52.148359 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:52.148319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" event={"ID":"55c384d0-1090-444c-a9c4-fc25451c78d4","Type":"ContainerStarted","Data":"550b7739dda65da168be5c1b2f59c2616e83db93ce295954e3a652ad2d8fad44"} Sep 08 02:26:54.161036 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:54.160999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" event={"ID":"55c384d0-1090-444c-a9c4-fc25451c78d4","Type":"ContainerStarted","Data":"dd304de67bb5182bb59f23d9b5bbd25218ed5ff60c2786d45b2319b371dcd8cb"} Sep 08 02:26:54.161460 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:54.161112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:26:54.188912 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:54.188861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" podStartSLOduration=1.774277822 podStartE2EDuration="4.188845914s" totalImagesPullingTime="2.414568092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:54.188220888 +0000 UTC m=+365.052427997" watchObservedRunningTime="2026-09-08 02:26:54.188845914 +0000 UTC m=+365.053053023" Sep 08 02:26:56.211656 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.211620 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d"] Sep 08 02:26:56.214799 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.214783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.218593 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.218571 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z4vcr\"" Sep 08 02:26:56.232521 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.232497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d"] Sep 08 02:26:56.273333 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.273300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhjn\" (UniqueName: \"kubernetes.io/projected/8f271ca6-ab71-4861-8452-0e9ba8132510-kube-api-access-kdhjn\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.273507 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.273373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f271ca6-ab71-4861-8452-0e9ba8132510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.374398 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.374356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhjn\" (UniqueName: \"kubernetes.io/projected/8f271ca6-ab71-4861-8452-0e9ba8132510-kube-api-access-kdhjn\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.374593 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.374438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f271ca6-ab71-4861-8452-0e9ba8132510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.374834 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.374816 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f271ca6-ab71-4861-8452-0e9ba8132510-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.386390 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.386350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhjn\" (UniqueName: \"kubernetes.io/projected/8f271ca6-ab71-4861-8452-0e9ba8132510-kube-api-access-kdhjn\") pod \"kuadrant-operator-controller-manager-7456d9997c-t684d\" (UID: \"8f271ca6-ab71-4861-8452-0e9ba8132510\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.524607 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.524516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:26:56.805450 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:56.805424 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d"] Sep 08 02:26:56.807651 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:56.807621 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f271ca6_ab71_4861_8452_0e9ba8132510.slice/crio-1930ab97c6d73f7e993b1bc3c62d5d36fc2688c8654e8f4b59236abfba1d59c8 WatchSource:0}: Error finding container 1930ab97c6d73f7e993b1bc3c62d5d36fc2688c8654e8f4b59236abfba1d59c8: Status 404 returned error can't find the container with id 1930ab97c6d73f7e993b1bc3c62d5d36fc2688c8654e8f4b59236abfba1d59c8 Sep 08 02:26:57.175832 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:57.175748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" event={"ID":"8f271ca6-ab71-4861-8452-0e9ba8132510","Type":"ContainerStarted","Data":"1930ab97c6d73f7e993b1bc3c62d5d36fc2688c8654e8f4b59236abfba1d59c8"} Sep 08 02:26:58.788548 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.788513 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-j7qsl"] Sep 08 02:26:58.792033 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.792009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:26:58.795761 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.795738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j79c6\"" Sep 08 02:26:58.808519 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.808489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-j7qsl"] Sep 08 02:26:58.897294 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.897258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkww9\" (UniqueName: \"kubernetes.io/projected/43387507-7dca-4704-8588-e23440452137-kube-api-access-rkww9\") pod \"authorino-operator-84d9bfc694-j7qsl\" (UID: \"43387507-7dca-4704-8588-e23440452137\") " pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:26:58.998485 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:58.998443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkww9\" (UniqueName: \"kubernetes.io/projected/43387507-7dca-4704-8588-e23440452137-kube-api-access-rkww9\") pod \"authorino-operator-84d9bfc694-j7qsl\" (UID: \"43387507-7dca-4704-8588-e23440452137\") " pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:26:59.011346 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:59.011314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkww9\" (UniqueName: \"kubernetes.io/projected/43387507-7dca-4704-8588-e23440452137-kube-api-access-rkww9\") pod \"authorino-operator-84d9bfc694-j7qsl\" (UID: \"43387507-7dca-4704-8588-e23440452137\") " pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:26:59.106430 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:59.106393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:26:59.417391 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:26:59.413640 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-j7qsl"] Sep 08 02:26:59.421167 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:26:59.421077 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43387507_7dca_4704_8588_e23440452137.slice/crio-9b546653d5c31fe6b2e2cb570ab0abcab082fae88691a8f0841f5a5bfebda698 WatchSource:0}: Error finding container 9b546653d5c31fe6b2e2cb570ab0abcab082fae88691a8f0841f5a5bfebda698: Status 404 returned error can't find the container with id 9b546653d5c31fe6b2e2cb570ab0abcab082fae88691a8f0841f5a5bfebda698 Sep 08 02:27:00.194205 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.194161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" event={"ID":"43387507-7dca-4704-8588-e23440452137","Type":"ContainerStarted","Data":"9b546653d5c31fe6b2e2cb570ab0abcab082fae88691a8f0841f5a5bfebda698"} Sep 08 02:27:00.367180 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.367129 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9"] Sep 08 02:27:00.387829 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.387797 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9"] Sep 08 02:27:00.388008 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.387923 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.391426 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.391401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hpwmh\"" Sep 08 02:27:00.512119 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h74pc\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-kube-api-access-h74pc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512119 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512119 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27bf2484-cc8c-46f0-959a-3054360b5027-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27bf2484-cc8c-46f0-959a-3054360b5027-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.512393 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.512366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613105 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h74pc\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-kube-api-access-h74pc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27bf2484-cc8c-46f0-959a-3054360b5027-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27bf2484-cc8c-46f0-959a-3054360b5027-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613312 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613551 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613551 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613551 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.613916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.613862 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.614053 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.614009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.614119 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.614050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.614241 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.614218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.614489 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.614469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27bf2484-cc8c-46f0-959a-3054360b5027-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.616956 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.616888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27bf2484-cc8c-46f0-959a-3054360b5027-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.617237 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.617212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27bf2484-cc8c-46f0-959a-3054360b5027-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.625752 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.625709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.626324 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.626305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h74pc\" (UniqueName: \"kubernetes.io/projected/27bf2484-cc8c-46f0-959a-3054360b5027-kube-api-access-h74pc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9\" (UID: \"27bf2484-cc8c-46f0-959a-3054360b5027\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:00.700966 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:00.700885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:01.628977 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:01.628951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9"] Sep 08 02:27:01.774766 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:27:01.774730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bf2484_cc8c_46f0_959a_3054360b5027.slice/crio-e932cf3b9d9dfe2c3efc07b444fcf40ed65a5d1ccb92900bd1c6aa82acd3e806 WatchSource:0}: Error finding container e932cf3b9d9dfe2c3efc07b444fcf40ed65a5d1ccb92900bd1c6aa82acd3e806: Status 404 returned error can't find the container with id e932cf3b9d9dfe2c3efc07b444fcf40ed65a5d1ccb92900bd1c6aa82acd3e806 Sep 08 02:27:01.799728 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:01.799677 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:27:01.799923 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:01.799799 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:27:01.799923 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:01.799842 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:27:02.209065 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.208938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" event={"ID":"8f271ca6-ab71-4861-8452-0e9ba8132510","Type":"ContainerStarted","Data":"0b7827ca22634d7822c9342b88cce7cfc7215f4ecee8bdba300eec449fbfd11e"} Sep 08 02:27:02.209267 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.209127 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:27:02.210890 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.210861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" event={"ID":"27bf2484-cc8c-46f0-959a-3054360b5027","Type":"ContainerStarted","Data":"366f63f9536f875c49778fa79ba0848dbf4e1a6ea423cf7714b86de89b7c6646"} Sep 08 02:27:02.211019 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.210922 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" event={"ID":"27bf2484-cc8c-46f0-959a-3054360b5027","Type":"ContainerStarted","Data":"e932cf3b9d9dfe2c3efc07b444fcf40ed65a5d1ccb92900bd1c6aa82acd3e806"} Sep 08 02:27:02.241614 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.241558 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" podStartSLOduration=1.234481145 podStartE2EDuration="6.241539411s" totalImagesPullingTime="5.007058266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:27:02.239350508 +0000 UTC m=+373.103557619" watchObservedRunningTime="2026-09-08 02:27:02.241539411 +0000 UTC m=+373.105746521" Sep 08 02:27:02.271682 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.271620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" podStartSLOduration=2.271597821 podStartE2EDuration="2.271597821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:27:02.269193741 +0000 UTC m=+373.133400873" watchObservedRunningTime="2026-09-08 02:27:02.271597821 +0000 UTC m=+373.135804932" Sep 08 02:27:02.701768 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.701729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:02.703270 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.703238 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Sep 08 02:27:02.703394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:02.703302 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" podUID="27bf2484-cc8c-46f0-959a-3054360b5027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Sep 08 02:27:03.217365 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:03.217322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" event={"ID":"43387507-7dca-4704-8588-e23440452137","Type":"ContainerStarted","Data":"b49bd433e37a43e58d5e562d16d8acc85c8336303b573d0988be5805cd6b7119"} Sep 08 02:27:03.217692 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:03.217660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:27:03.243380 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:03.243333 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" podStartSLOduration=2.206767321 podStartE2EDuration="5.243319396s" totalImagesPullingTime="3.036552075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:27:03.242214256 +0000 UTC m=+374.106421365" watchObservedRunningTime="2026-09-08 02:27:03.243319396 +0000 UTC m=+374.107526506" Sep 08 02:27:03.705418 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:03.705385 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:04.222320 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.222283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:04.223252 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.223229 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9" Sep 08 02:27:04.896551 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.896511 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-2762g"] Sep 08 02:27:04.900002 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.899985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:04.902613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.902587 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 08 02:27:04.902613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.902587 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 08 02:27:04.902774 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.902659 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jrgr6\"" Sep 08 02:27:04.910600 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:04.910578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-2762g"] Sep 08 02:27:05.051466 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.051435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83819980-7283-4b51-80b1-5570521aaead-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.051466 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.051471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2r8f\" (UniqueName: \"kubernetes.io/projected/83819980-7283-4b51-80b1-5570521aaead-kube-api-access-d2r8f\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.051688 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.051566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83819980-7283-4b51-80b1-5570521aaead-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.152674 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.152579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83819980-7283-4b51-80b1-5570521aaead-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.152674 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.152638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83819980-7283-4b51-80b1-5570521aaead-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.152674 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.152662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2r8f\" (UniqueName: \"kubernetes.io/projected/83819980-7283-4b51-80b1-5570521aaead-kube-api-access-d2r8f\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.153330 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.153311 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83819980-7283-4b51-80b1-5570521aaead-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.155058 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.155038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83819980-7283-4b51-80b1-5570521aaead-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.161001 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.160976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2r8f\" (UniqueName: \"kubernetes.io/projected/83819980-7283-4b51-80b1-5570521aaead-kube-api-access-d2r8f\") pod \"kuadrant-console-plugin-598f86468b-2762g\" (UID: \"83819980-7283-4b51-80b1-5570521aaead\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.167914 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.167889 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ktq7z" Sep 08 02:27:05.208988 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.208944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" Sep 08 02:27:05.487776 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:05.487652 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-2762g"] Sep 08 02:27:05.490644 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:27:05.490618 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83819980_7283_4b51_80b1_5570521aaead.slice/crio-1be467efbe320b4bde9d07d3a84ed95a051546ff9d0e10683d36b558c9113e65 WatchSource:0}: Error finding container 1be467efbe320b4bde9d07d3a84ed95a051546ff9d0e10683d36b558c9113e65: Status 404 returned error can't find the container with id 1be467efbe320b4bde9d07d3a84ed95a051546ff9d0e10683d36b558c9113e65 Sep 08 02:27:06.233124 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:06.233089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" event={"ID":"83819980-7283-4b51-80b1-5570521aaead","Type":"ContainerStarted","Data":"1be467efbe320b4bde9d07d3a84ed95a051546ff9d0e10683d36b558c9113e65"} Sep 08 02:27:11.263819 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:11.263781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" event={"ID":"83819980-7283-4b51-80b1-5570521aaead","Type":"ContainerStarted","Data":"f0b6e527c72939023b43f4f1d0bc79ead47a3a8acdc57671e95e9804a5f93661"} Sep 08 02:27:11.282901 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:11.282848 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-2762g" podStartSLOduration=2.188687601 podStartE2EDuration="7.282832885s" totalImagesPullingTime="5.094145284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:27:11.281487462 +0000 UTC m=+382.145694574" watchObservedRunningTime="2026-09-08 02:27:11.282832885 +0000 UTC m=+382.147039995" Sep 08 02:27:13.220126 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:13.220092 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-t684d" Sep 08 02:27:15.230290 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:15.230256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-j7qsl" Sep 08 02:27:19.671522 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.669102 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:19.674994 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.674967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.677651 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.677622 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 08 02:27:19.677806 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.677765 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 08 02:27:19.677969 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.677879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 02:27:19.678771 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.678748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 02:27:19.678875 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.678819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6fs2r\"" Sep 08 02:27:19.678875 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.678828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 08 02:27:19.682597 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.682572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:19.685858 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.685836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.685950 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.685866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mvf7\" (UniqueName: \"kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.685950 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.685891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.786414 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.786377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.786414 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.786420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mvf7\" (UniqueName: \"kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.786641 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.786447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:19.786641 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:27:19.786526 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 08 02:27:19.786641 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:27:19.786566 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 08 02:27:19.786641 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:27:19.786607 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs podName:4a98563d-4bac-4354-be20-b81a309ea51f nodeName:}" failed. No retries permitted until 2026-09-08 02:27:20.286589067 +0000 UTC m=+391.150796155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs") pod "maas-controller-7848477867-7dmwd" (UID: "4a98563d-4bac-4354-be20-b81a309ea51f") : secret "maas-controller-metrics-tls" not found Sep 08 02:27:19.786641 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:27:19.786621 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert podName:4a98563d-4bac-4354-be20-b81a309ea51f nodeName:}" failed. No retries permitted until 2026-09-08 02:27:20.28661496 +0000 UTC m=+391.150822048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert") pod "maas-controller-7848477867-7dmwd" (UID: "4a98563d-4bac-4354-be20-b81a309ea51f") : secret "maas-controller-webhook-cert" not found Sep 08 02:27:19.800827 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:19.800792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mvf7\" (UniqueName: \"kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.289524 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.289490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.289697 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.289535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.291797 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.291761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.291914 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.291820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") pod \"maas-controller-7848477867-7dmwd\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.586496 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.586457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:20.865214 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:20.865033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:20.867743 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:27:20.867711 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a98563d_4bac_4354_be20_b81a309ea51f.slice/crio-6dd5dcd51e1edef59ae4952a0c19e406fa17a67db7a4b6ee901dc3737dc19d1c WatchSource:0}: Error finding container 6dd5dcd51e1edef59ae4952a0c19e406fa17a67db7a4b6ee901dc3737dc19d1c: Status 404 returned error can't find the container with id 6dd5dcd51e1edef59ae4952a0c19e406fa17a67db7a4b6ee901dc3737dc19d1c Sep 08 02:27:21.311898 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:21.311857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7848477867-7dmwd" event={"ID":"4a98563d-4bac-4354-be20-b81a309ea51f","Type":"ContainerStarted","Data":"6dd5dcd51e1edef59ae4952a0c19e406fa17a67db7a4b6ee901dc3737dc19d1c"} Sep 08 02:27:22.319294 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:22.319249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7848477867-7dmwd" event={"ID":"4a98563d-4bac-4354-be20-b81a309ea51f","Type":"ContainerStarted","Data":"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed"} Sep 08 02:27:22.319694 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:22.319424 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:22.349175 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:22.349099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7848477867-7dmwd" podStartSLOduration=2.043243323 podStartE2EDuration="3.34907908s" totalImagesPullingTime="1.305835757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:27:22.347413466 +0000 UTC m=+393.211620576" watchObservedRunningTime="2026-09-08 02:27:22.34907908 +0000 UTC m=+393.213286189" Sep 08 02:27:33.327012 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:33.326978 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:33.752769 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:33.752690 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:33.752922 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:33.752870 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7848477867-7dmwd" podUID="4a98563d-4bac-4354-be20-b81a309ea51f" containerName="manager" containerID="cri-o://1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed" gracePeriod=30 Sep 08 02:27:34.040253 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.040180 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:34.104994 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.104959 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") pod \"4a98563d-4bac-4354-be20-b81a309ea51f\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " Sep 08 02:27:34.105204 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.105012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mvf7\" (UniqueName: \"kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7\") pod \"4a98563d-4bac-4354-be20-b81a309ea51f\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " Sep 08 02:27:34.105204 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.105100 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") pod \"4a98563d-4bac-4354-be20-b81a309ea51f\" (UID: \"4a98563d-4bac-4354-be20-b81a309ea51f\") " Sep 08 02:27:34.107322 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.107288 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4a98563d-4bac-4354-be20-b81a309ea51f" (UID: "4a98563d-4bac-4354-be20-b81a309ea51f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:27:34.107322 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.107312 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4a98563d-4bac-4354-be20-b81a309ea51f" (UID: "4a98563d-4bac-4354-be20-b81a309ea51f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 02:27:34.107466 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.107392 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7" (OuterVolumeSpecName: "kube-api-access-6mvf7") pod "4a98563d-4bac-4354-be20-b81a309ea51f" (UID: "4a98563d-4bac-4354-be20-b81a309ea51f"). InnerVolumeSpecName "kube-api-access-6mvf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 02:27:34.206117 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.206078 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-webhook-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:27:34.206117 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.206111 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a98563d-4bac-4354-be20-b81a309ea51f-metrics-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:27:34.206341 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.206125 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mvf7\" (UniqueName: \"kubernetes.io/projected/4a98563d-4bac-4354-be20-b81a309ea51f-kube-api-access-6mvf7\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 08 02:27:34.377493 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.377458 2581 generic.go:356] "Generic (PLEG): container finished" podID="4a98563d-4bac-4354-be20-b81a309ea51f" containerID="1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed" exitCode=0 Sep 08 02:27:34.377916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.377504 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7848477867-7dmwd" Sep 08 02:27:34.377916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.377516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7848477867-7dmwd" event={"ID":"4a98563d-4bac-4354-be20-b81a309ea51f","Type":"ContainerDied","Data":"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed"} Sep 08 02:27:34.377916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.377593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7848477867-7dmwd" event={"ID":"4a98563d-4bac-4354-be20-b81a309ea51f","Type":"ContainerDied","Data":"6dd5dcd51e1edef59ae4952a0c19e406fa17a67db7a4b6ee901dc3737dc19d1c"} Sep 08 02:27:34.377916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.377619 2581 scope.go:117] "RemoveContainer" containerID="1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed" Sep 08 02:27:34.386774 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.386754 2581 scope.go:117] "RemoveContainer" containerID="1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed" Sep 08 02:27:34.387053 ip-10-0-142-110 kubenswrapper[2581]: E0908 02:27:34.387035 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed\": container with ID starting with 1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed not found: ID does not exist" containerID="1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed" Sep 08 02:27:34.387101 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.387061 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed"} err="failed to get container status \"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed\": rpc error: code = NotFound desc = could not find container \"1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed\": container with ID starting with 1843fd996551ec7a89bcd95eb900002fe71efd958997d9c4a26f46185f44ffed not found: ID does not exist" Sep 08 02:27:34.398663 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.398639 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:34.402482 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:34.402451 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7848477867-7dmwd"] Sep 08 02:27:35.664315 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:35.664284 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a98563d-4bac-4354-be20-b81a309ea51f" path="/var/lib/kubelet/pods/4a98563d-4bac-4354-be20-b81a309ea51f/volumes" Sep 08 02:27:55.705879 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.705844 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5"] Sep 08 02:27:55.706340 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.706167 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a98563d-4bac-4354-be20-b81a309ea51f" containerName="manager" Sep 08 02:27:55.706340 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.706179 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a98563d-4bac-4354-be20-b81a309ea51f" containerName="manager" Sep 08 02:27:55.706340 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.706240 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a98563d-4bac-4354-be20-b81a309ea51f" containerName="manager" Sep 08 02:27:55.710975 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.710953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.713523 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.713504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 02:27:55.713865 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.713846 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 02:27:55.714145 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.714116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 08 02:27:55.714645 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.714627 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jb5h5\"" Sep 08 02:27:55.721890 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.721867 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5"] Sep 08 02:27:55.791033 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.791002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05011c4c-492a-47ed-9ade-a3cdcd489309-cert\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.791237 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.791063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkhcn\" (UniqueName: \"kubernetes.io/projected/05011c4c-492a-47ed-9ade-a3cdcd489309-kube-api-access-tkhcn\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.892394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.892362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05011c4c-492a-47ed-9ade-a3cdcd489309-cert\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.892564 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.892420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkhcn\" (UniqueName: \"kubernetes.io/projected/05011c4c-492a-47ed-9ade-a3cdcd489309-kube-api-access-tkhcn\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.894997 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.894973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05011c4c-492a-47ed-9ade-a3cdcd489309-cert\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:55.903440 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:55.903415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkhcn\" (UniqueName: \"kubernetes.io/projected/05011c4c-492a-47ed-9ade-a3cdcd489309-kube-api-access-tkhcn\") pod \"llmisvc-controller-manager-7d548556bc-qcrd5\" (UID: \"05011c4c-492a-47ed-9ade-a3cdcd489309\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:56.021102 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.021026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:27:56.296023 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.295964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5"] Sep 08 02:27:56.298398 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:27:56.298372 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05011c4c_492a_47ed_9ade_a3cdcd489309.slice/crio-22759e70f5fa0c7193e970415c1da4d4c6658775f955547b61472ba35c72808a WatchSource:0}: Error finding container 22759e70f5fa0c7193e970415c1da4d4c6658775f955547b61472ba35c72808a: Status 404 returned error can't find the container with id 22759e70f5fa0c7193e970415c1da4d4c6658775f955547b61472ba35c72808a Sep 08 02:27:56.486339 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.486302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" event={"ID":"05011c4c-492a-47ed-9ade-a3cdcd489309","Type":"ContainerStarted","Data":"22759e70f5fa0c7193e970415c1da4d4c6658775f955547b61472ba35c72808a"} Sep 08 02:27:56.614011 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.613978 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn"] Sep 08 02:27:56.618592 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.618576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.623377 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.623353 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 08 02:27:56.623510 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.623412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-84lg2\"" Sep 08 02:27:56.631986 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.631961 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn"] Sep 08 02:27:56.699828 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.699795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.699985 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.699835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bh9c\" (UniqueName: \"kubernetes.io/projected/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-kube-api-access-5bh9c\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.801311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.801268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.801825 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.801323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bh9c\" (UniqueName: \"kubernetes.io/projected/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-kube-api-access-5bh9c\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.802279 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.802253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.810283 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.810249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bh9c\" (UniqueName: \"kubernetes.io/projected/cf121abe-f8b6-4ad6-90e1-f601bf5393cb-kube-api-access-5bh9c\") pod \"payload-pre-processing-59fbc47bf8-sc9qn\" (UID: \"cf121abe-f8b6-4ad6-90e1-f601bf5393cb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:56.929344 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:56.929244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:27:57.222388 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:57.222359 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn"] Sep 08 02:27:57.224790 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:27:57.224763 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf121abe_f8b6_4ad6_90e1_f601bf5393cb.slice/crio-cc490e582788feaec70b0d4f5563e735a19872639877e7ce1ff70ff2179556e9 WatchSource:0}: Error finding container cc490e582788feaec70b0d4f5563e735a19872639877e7ce1ff70ff2179556e9: Status 404 returned error can't find the container with id cc490e582788feaec70b0d4f5563e735a19872639877e7ce1ff70ff2179556e9 Sep 08 02:27:57.500926 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:27:57.500842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" event={"ID":"cf121abe-f8b6-4ad6-90e1-f601bf5393cb","Type":"ContainerStarted","Data":"cc490e582788feaec70b0d4f5563e735a19872639877e7ce1ff70ff2179556e9"} Sep 08 02:28:00.519094 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:00.519051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" event={"ID":"cf121abe-f8b6-4ad6-90e1-f601bf5393cb","Type":"ContainerStarted","Data":"faac18815e65081c18015cc6b519ab35387ef77c3c10325bae72d8d0a6f318e8"} Sep 08 02:28:00.519544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:00.519121 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:28:00.520682 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:00.520648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" event={"ID":"05011c4c-492a-47ed-9ade-a3cdcd489309","Type":"ContainerStarted","Data":"42828ae0058b17d812663bf8c5589e303b827a2b0bb8855a0ec430d358ec5e39"} Sep 08 02:28:00.520815 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:00.520704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:28:00.538929 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:00.538880 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" podStartSLOduration=2.258703351 podStartE2EDuration="4.538864539s" totalImagesPullingTime="2.280161188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:28:00.537267402 +0000 UTC m=+431.401474513" watchObservedRunningTime="2026-09-08 02:28:00.538864539 +0000 UTC m=+431.403071667" Sep 08 02:28:03.954343 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:03.954299 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 08 02:28:03.954757 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:03.954373 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 02:28:06.558449 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.558413 2581 generic.go:356] "Generic (PLEG): container finished" podID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerID="e2e1c27e9f9d8e6d092e12a2e93eb3fbee56fa51ac8365bdab6cf482cfcd1bfe" exitCode=0 Sep 08 02:28:06.558898 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.558490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" event={"ID":"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b","Type":"ContainerDied","Data":"e2e1c27e9f9d8e6d092e12a2e93eb3fbee56fa51ac8365bdab6cf482cfcd1bfe"} Sep 08 02:28:06.558898 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.558878 2581 scope.go:117] "RemoveContainer" containerID="e2e1c27e9f9d8e6d092e12a2e93eb3fbee56fa51ac8365bdab6cf482cfcd1bfe" Sep 08 02:28:06.559859 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.559830 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:28:06.559931 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.559916 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:28:06.559979 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.559953 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 08 02:28:06.582727 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:06.582682 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" podStartSLOduration=8.378139899 podStartE2EDuration="11.582666308s" totalImagesPullingTime="3.204526409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:28:00.557048106 +0000 UTC m=+431.421255216" watchObservedRunningTime="2026-09-08 02:28:06.582666308 +0000 UTC m=+437.446873419" Sep 08 02:28:07.565311 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:07.565272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" event={"ID":"cbabf975-d8f0-4b21-9dc2-4c2c9eec368b","Type":"ContainerStarted","Data":"2c0eb016aaa9e6ac7f42973b3325ca814298db52cf1f99fb90778d07070baf3b"} Sep 08 02:28:07.827791 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:07.827704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:28:07.828028 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:07.828005 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= Sep 08 02:28:07.828094 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:07.828075 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" Sep 08 02:28:08.827884 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:08.827842 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= Sep 08 02:28:08.828298 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:08.827909 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" Sep 08 02:28:09.607700 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.607659 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-bdfd95689-vf88m"] Sep 08 02:28:09.611099 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.611082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.614989 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.614964 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 08 02:28:09.615332 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.615265 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7gn54\"" Sep 08 02:28:09.615332 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.615304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 08 02:28:09.615332 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.615305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 08 02:28:09.615555 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.615304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 08 02:28:09.620978 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.620956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bdfd95689-vf88m"] Sep 08 02:28:09.717521 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.717482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43972e25-6435-49d5-96f9-3b6c17ccff4a-openshift-service-ca\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.717722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.717531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-metrics-certs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.717722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.717563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-maas-api-tls\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.717722 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.717658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2hs\" (UniqueName: \"kubernetes.io/projected/43972e25-6435-49d5-96f9-3b6c17ccff4a-kube-api-access-wk2hs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.818983 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.818945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43972e25-6435-49d5-96f9-3b6c17ccff4a-openshift-service-ca\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.819222 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.818995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-metrics-certs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.819222 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.819021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-maas-api-tls\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.819222 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.819049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2hs\" (UniqueName: \"kubernetes.io/projected/43972e25-6435-49d5-96f9-3b6c17ccff4a-kube-api-access-wk2hs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.819753 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.819725 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43972e25-6435-49d5-96f9-3b6c17ccff4a-openshift-service-ca\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.821569 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.821549 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-metrics-certs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.821719 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.821691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43972e25-6435-49d5-96f9-3b6c17ccff4a-maas-api-tls\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.827727 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.827701 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= Sep 08 02:28:09.827818 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.827764 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" Sep 08 02:28:09.827899 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.827831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2hs\" (UniqueName: \"kubernetes.io/projected/43972e25-6435-49d5-96f9-3b6c17ccff4a-kube-api-access-wk2hs\") pod \"maas-api-bdfd95689-vf88m\" (UID: \"43972e25-6435-49d5-96f9-3b6c17ccff4a\") " pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:09.922554 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:09.922469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:10.225576 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:10.225500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bdfd95689-vf88m"] Sep 08 02:28:10.228660 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:28:10.228631 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43972e25_6435_49d5_96f9_3b6c17ccff4a.slice/crio-8d9e5710c0a4fd57faee38b261c91008f950ecfe0ac460e0d1df6e11b9ff301b WatchSource:0}: Error finding container 8d9e5710c0a4fd57faee38b261c91008f950ecfe0ac460e0d1df6e11b9ff301b: Status 404 returned error can't find the container with id 8d9e5710c0a4fd57faee38b261c91008f950ecfe0ac460e0d1df6e11b9ff301b Sep 08 02:28:10.592424 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:10.592381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" event={"ID":"43972e25-6435-49d5-96f9-3b6c17ccff4a","Type":"ContainerStarted","Data":"8d9e5710c0a4fd57faee38b261c91008f950ecfe0ac460e0d1df6e11b9ff301b"} Sep 08 02:28:10.827801 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:10.827579 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= Sep 08 02:28:10.827801 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:10.827632 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" Sep 08 02:28:11.528710 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:11.528677 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-sc9qn" Sep 08 02:28:11.828755 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:11.828711 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzdqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body= Sep 08 02:28:11.828961 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:11.828785 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" podUID="cbabf975-d8f0-4b21-9dc2-4c2c9eec368b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" Sep 08 02:28:12.610897 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.610857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" event={"ID":"43972e25-6435-49d5-96f9-3b6c17ccff4a","Type":"ContainerStarted","Data":"047afa6542c54ab699bde0cb644cd6941cd9f78638e2ddff0c1274134c9d4c39"} Sep 08 02:28:12.611443 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.611002 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:12.632591 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.632527 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" podStartSLOduration=1.950553325 podStartE2EDuration="3.632509881s" totalImagesPullingTime="1.681956556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:28:12.630752385 +0000 UTC m=+443.494959508" watchObservedRunningTime="2026-09-08 02:28:12.632509881 +0000 UTC m=+443.496716990" Sep 08 02:28:12.831438 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.831396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:28:12.831725 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.831704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:28:12.832394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:12.832372 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzdqd" Sep 08 02:28:18.621956 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:18.621921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-bdfd95689-vf88m" Sep 08 02:28:31.528048 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:28:31.528014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-qcrd5" Sep 08 02:29:27.632630 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.632586 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9"] Sep 08 02:29:27.635988 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.635964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.638593 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.638569 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 08 02:29:27.638733 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.638656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 08 02:29:27.639496 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.639475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q24xq\"" Sep 08 02:29:27.639595 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.639528 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 08 02:29:27.646108 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.646086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9"] Sep 08 02:29:27.669867 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.669841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.669887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lknpx\" (UniqueName: \"kubernetes.io/projected/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-kube-api-access-lknpx\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.669949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.669976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.670052 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.670032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.670286 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.670108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771187 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771187 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771187 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771455 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lknpx\" (UniqueName: \"kubernetes.io/projected/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-kube-api-access-lknpx\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771455 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771455 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771665 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771726 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.771852 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.771827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.773592 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.773562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.773816 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.773800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.779554 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.779527 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lknpx\" (UniqueName: \"kubernetes.io/projected/11706d4e-3ac5-461d-bd3c-e1f1165b1de3-kube-api-access-lknpx\") pod \"e2e-embedding-simulated-kserve-698db7d589-c9wh9\" (UID: \"11706d4e-3ac5-461d-bd3c-e1f1165b1de3\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:27.946989 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:27.946951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:28.228446 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:28.228347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9"] Sep 08 02:29:28.229989 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:29:28.229959 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11706d4e_3ac5_461d_bd3c_e1f1165b1de3.slice/crio-104a2d963ce99c9df911ea7f6323647ae2a27ec2cb520f11f80fa80eb28d581f WatchSource:0}: Error finding container 104a2d963ce99c9df911ea7f6323647ae2a27ec2cb520f11f80fa80eb28d581f: Status 404 returned error can't find the container with id 104a2d963ce99c9df911ea7f6323647ae2a27ec2cb520f11f80fa80eb28d581f Sep 08 02:29:28.990373 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:28.990324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" event={"ID":"11706d4e-3ac5-461d-bd3c-e1f1165b1de3","Type":"ContainerStarted","Data":"104a2d963ce99c9df911ea7f6323647ae2a27ec2cb520f11f80fa80eb28d581f"} Sep 08 02:29:29.996830 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:29.996792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" event={"ID":"11706d4e-3ac5-461d-bd3c-e1f1165b1de3","Type":"ContainerStarted","Data":"97279aed572d9ed69c252e7beb153e1b0540e0f4ca186992f229b91e78352db1"} Sep 08 02:29:30.018344 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:30.018294 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" podStartSLOduration=2.042244848 podStartE2EDuration="3.018276253s" totalImagesPullingTime="976.031405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:29:30.017166693 +0000 UTC m=+520.881373801" watchObservedRunningTime="2026-09-08 02:29:30.018276253 +0000 UTC m=+520.882483391" Sep 08 02:29:30.947613 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:30.947578 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:37.947849 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:37.947806 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:37.960524 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:37.960497 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:38.053187 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:38.053157 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-c9wh9" Sep 08 02:29:52.233792 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.233757 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz"] Sep 08 02:29:52.237237 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.237214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.240066 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.240042 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 08 02:29:52.249974 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.249944 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz"] Sep 08 02:29:52.389203 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nf8w\" (UniqueName: \"kubernetes.io/projected/14821a28-baec-4c30-a244-e4c3d0f83fc6-kube-api-access-7nf8w\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.389405 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.389405 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.389405 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.389405 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.389405 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.389339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14821a28-baec-4c30-a244-e4c3d0f83fc6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.490844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.490844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.490844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.490844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.490844 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14821a28-baec-4c30-a244-e4c3d0f83fc6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.491293 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.490900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nf8w\" (UniqueName: \"kubernetes.io/projected/14821a28-baec-4c30-a244-e4c3d0f83fc6-kube-api-access-7nf8w\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.491358 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.491299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.491358 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.491336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.491358 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.491351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.493156 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.493119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14821a28-baec-4c30-a244-e4c3d0f83fc6-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.493418 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.493397 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14821a28-baec-4c30-a244-e4c3d0f83fc6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.508038 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.508000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nf8w\" (UniqueName: \"kubernetes.io/projected/14821a28-baec-4c30-a244-e4c3d0f83fc6-kube-api-access-7nf8w\") pod \"facebook-opt-125m-simulated-kserve-89945f574-8g7kz\" (UID: \"14821a28-baec-4c30-a244-e4c3d0f83fc6\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.548067 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.548018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:29:52.845051 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:52.845025 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz"] Sep 08 02:29:52.847416 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:29:52.847390 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14821a28_baec_4c30_a244_e4c3d0f83fc6.slice/crio-78290064ceda08d26fd39051ca62136497fdfe63425fd836d92f18feb0d3f6b8 WatchSource:0}: Error finding container 78290064ceda08d26fd39051ca62136497fdfe63425fd836d92f18feb0d3f6b8: Status 404 returned error can't find the container with id 78290064ceda08d26fd39051ca62136497fdfe63425fd836d92f18feb0d3f6b8 Sep 08 02:29:53.122257 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:53.122217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" event={"ID":"14821a28-baec-4c30-a244-e4c3d0f83fc6","Type":"ContainerStarted","Data":"2e86e369d1be1a3a4a91a325cea1320b835a03d9678aa17a11eed520006b736d"} Sep 08 02:29:53.122374 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:53.122289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" event={"ID":"14821a28-baec-4c30-a244-e4c3d0f83fc6","Type":"ContainerStarted","Data":"78290064ceda08d26fd39051ca62136497fdfe63425fd836d92f18feb0d3f6b8"} Sep 08 02:29:53.144068 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:53.144019 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" podStartSLOduration=0.951726549 podStartE2EDuration="1.144002067s" totalImagesPullingTime="192.275518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:29:53.142642954 +0000 UTC m=+544.006850075" watchObservedRunningTime="2026-09-08 02:29:53.144002067 +0000 UTC m=+544.008209222" Sep 08 02:29:53.549183 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:29:53.549057 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:30:02.549292 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:30:02.549253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:30:02.561698 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:30:02.561678 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:30:03.186414 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:30:03.186380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-8g7kz" Sep 08 02:36:27.963218 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:27.963184 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-qcrd5_05011c4c-492a-47ed-9ade-a3cdcd489309/manager/0.log" Sep 08 02:36:28.746821 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:28.746787 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-bdfd95689-vf88m_43972e25-6435-49d5-96f9-3b6c17ccff4a/maas-api/0.log" Sep 08 02:36:29.958905 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:29.958860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-j7qsl_43387507-7dca-4704-8588-e23440452137/manager/0.log" Sep 08 02:36:30.200791 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:30.200761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-2762g_83819980-7283-4b51-80b1-5570521aaead/kuadrant-console-plugin/0.log" Sep 08 02:36:30.328773 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:30.328728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-t684d_8f271ca6-ab71-4861-8452-0e9ba8132510/manager/0.log" Sep 08 02:36:30.572702 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:30.572669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-ktq7z_55c384d0-1090-444c-a9c4-fc25451c78d4/manager/0.log" Sep 08 02:36:30.952440 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:30.952399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9_27bf2484-cc8c-46f0-959a-3054360b5027/istio-proxy/0.log" Sep 08 02:36:31.452544 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:31.452513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/1.log" Sep 08 02:36:31.570763 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:31.570727 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np_cdd566e7-745a-49d3-821b-147d5408932e/istio-proxy/0.log" Sep 08 02:36:31.681869 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:31.681841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-sc9qn_cf121abe-f8b6-4ad6-90e1-f601bf5393cb/payload-pre-processing/0.log" Sep 08 02:36:32.486089 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:32.486053 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-c9wh9_11706d4e-3ac5-461d-bd3c-e1f1165b1de3/main/0.log" Sep 08 02:36:32.852612 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:32.852577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-8g7kz_14821a28-baec-4c30-a244-e4c3d0f83fc6/main/0.log" Sep 08 02:36:41.828394 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:41.828355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-49fq7_22fd687d-cbcc-47c4-9269-f3b113bf9bfe/global-pull-secret-syncer/0.log" Sep 08 02:36:42.024203 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:42.024172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tpxcx_71bcacec-4773-492a-a0f9-137876f52a73/konnectivity-agent/0.log" Sep 08 02:36:42.093399 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:42.093306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-110.ec2.internal_f655c0765fbd80af788f254065029567/haproxy/0.log" Sep 08 02:36:46.653207 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:46.653161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-j7qsl_43387507-7dca-4704-8588-e23440452137/manager/0.log" Sep 08 02:36:46.711150 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:46.711121 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-2762g_83819980-7283-4b51-80b1-5570521aaead/kuadrant-console-plugin/0.log" Sep 08 02:36:46.777403 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:46.777370 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-t684d_8f271ca6-ab71-4861-8452-0e9ba8132510/manager/0.log" Sep 08 02:36:46.836307 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:46.836275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-ktq7z_55c384d0-1090-444c-a9c4-fc25451c78d4/manager/0.log" Sep 08 02:36:48.695991 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:48.695957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vdz6_a3d077e9-0587-42be-94d4-b90822427d27/node-exporter/0.log" Sep 08 02:36:48.737748 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:48.737712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vdz6_a3d077e9-0587-42be-94d4-b90822427d27/kube-rbac-proxy/0.log" Sep 08 02:36:48.775354 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:48.775323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2vdz6_a3d077e9-0587-42be-94d4-b90822427d27/init-textfile/0.log" Sep 08 02:36:51.696366 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.696332 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l"] Sep 08 02:36:51.700277 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.700258 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.702795 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.702765 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jf4m6\"/\"openshift-service-ca.crt\"" Sep 08 02:36:51.702916 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.702797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jf4m6\"/\"kube-root-ca.crt\"" Sep 08 02:36:51.703807 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.703788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jf4m6\"/\"default-dockercfg-qzs9c\"" Sep 08 02:36:51.715195 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.715171 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l"] Sep 08 02:36:51.891920 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.891881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-proc\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.892092 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.891939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-sys\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.892092 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.891999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-lib-modules\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.892092 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.892037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7m7\" (UniqueName: \"kubernetes.io/projected/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-kube-api-access-cr7m7\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.892092 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.892084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-podres\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993454 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-sys\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993454 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-lib-modules\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993454 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7m7\" (UniqueName: \"kubernetes.io/projected/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-kube-api-access-cr7m7\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-sys\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-podres\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-lib-modules\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-podres\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-proc\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:51.993735 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:51.993705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-proc\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:52.002719 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:52.002691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7m7\" (UniqueName: \"kubernetes.io/projected/b7ce98ba-38c9-4c32-ae7c-c782e593b4b4-kube-api-access-cr7m7\") pod \"perf-node-gather-daemonset-sns2l\" (UID: \"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4\") " pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:52.010127 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:52.010103 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:52.281339 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:52.281309 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l"] Sep 08 02:36:52.283897 ip-10-0-142-110 kubenswrapper[2581]: W0908 02:36:52.283862 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7ce98ba_38c9_4c32_ae7c_c782e593b4b4.slice/crio-909017698de2d721a6540d3bb0c026cad107439799908c5195b1ca1357f57783 WatchSource:0}: Error finding container 909017698de2d721a6540d3bb0c026cad107439799908c5195b1ca1357f57783: Status 404 returned error can't find the container with id 909017698de2d721a6540d3bb0c026cad107439799908c5195b1ca1357f57783 Sep 08 02:36:52.314342 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:52.314296 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" event={"ID":"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4","Type":"ContainerStarted","Data":"909017698de2d721a6540d3bb0c026cad107439799908c5195b1ca1357f57783"} Sep 08 02:36:53.320880 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:53.320839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" event={"ID":"b7ce98ba-38c9-4c32-ae7c-c782e593b4b4","Type":"ContainerStarted","Data":"5d9d7249788f7c6d24a3b7a98ce43a26b495c1adea03d5e2f7356eca238d8ac0"} Sep 08 02:36:53.321273 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:53.320953 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:53.341062 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:53.341013 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" podStartSLOduration=2.340999241 podStartE2EDuration="2.340999241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:36:53.339027492 +0000 UTC m=+964.203234603" watchObservedRunningTime="2026-09-08 02:36:53.340999241 +0000 UTC m=+964.205206352" Sep 08 02:36:54.131184 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:54.131153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dr8xs_fc81df56-c592-44b7-b55e-8a7a815dcd94/dns/0.log" Sep 08 02:36:54.155293 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:54.155264 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dr8xs_fc81df56-c592-44b7-b55e-8a7a815dcd94/kube-rbac-proxy/0.log" Sep 08 02:36:54.307099 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:54.307066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fpdgq_7824f8c1-1a41-4479-8ff8-2e9b29bdb559/dns-node-resolver/0.log" Sep 08 02:36:54.910793 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:54.910755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jltf6_521996c4-d0ba-41fc-bd0e-ebc8b04ff01c/node-ca/0.log" Sep 08 02:36:55.903215 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:55.903185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9_27bf2484-cc8c-46f0-959a-3054360b5027/istio-proxy/0.log" Sep 08 02:36:56.061896 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:56.061863 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/0.log" Sep 08 02:36:56.064780 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:56.064755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/1.log" Sep 08 02:36:56.091180 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:56.091129 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np_cdd566e7-745a-49d3-821b-147d5408932e/istio-proxy/0.log" Sep 08 02:36:56.117543 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:56.117510 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-sc9qn_cf121abe-f8b6-4ad6-90e1-f601bf5393cb/payload-pre-processing/0.log" Sep 08 02:36:56.875743 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:56.875711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmprg_f344173d-b945-4345-8a34-a2de4986ae42/serve-healthcheck-canary/0.log" Sep 08 02:36:57.572374 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:57.572333 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbj65_c719264d-2838-4148-9a7f-9e77ec64b873/kube-rbac-proxy/0.log" Sep 08 02:36:57.596304 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:57.596277 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbj65_c719264d-2838-4148-9a7f-9e77ec64b873/exporter/0.log" Sep 08 02:36:57.620532 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:57.620503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbj65_c719264d-2838-4148-9a7f-9e77ec64b873/extractor/0.log" Sep 08 02:36:59.335373 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:59.335347 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jf4m6/perf-node-gather-daemonset-sns2l" Sep 08 02:36:59.848381 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:59.848354 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5c89fb8b78-fz5p5_ced6cd71-1f4e-4dff-b337-07a471ce5383/manager/0.log" Sep 08 02:36:59.871413 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:36:59.871382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5c89fb8b78-fz5p5_ced6cd71-1f4e-4dff-b337-07a471ce5383/copy-manifests/0.log" Sep 08 02:37:01.189319 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.189284 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9_27bf2484-cc8c-46f0-959a-3054360b5027/istio-proxy/0.log" Sep 08 02:37:01.323892 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.323860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-g4q5l_8f41d342-d644-4225-a03a-a117548dee33/jobset-operator/0.log" Sep 08 02:37:01.350969 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.350936 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/0.log" Sep 08 02:37:01.353539 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.353508 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/1.log" Sep 08 02:37:01.369550 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.369524 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np_cdd566e7-745a-49d3-821b-147d5408932e/istio-proxy/0.log" Sep 08 02:37:01.387006 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:01.386942 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-sc9qn_cf121abe-f8b6-4ad6-90e1-f601bf5393cb/payload-pre-processing/0.log" Sep 08 02:37:02.172444 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.172400 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-qcrd5_05011c4c-492a-47ed-9ade-a3cdcd489309/manager/0.log" Sep 08 02:37:02.690022 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.689979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dbbv9_27bf2484-cc8c-46f0-959a-3054360b5027/istio-proxy/0.log" Sep 08 02:37:02.821083 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.821042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/0.log" Sep 08 02:37:02.824125 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.824096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzdqd_cbabf975-d8f0-4b21-9dc2-4c2c9eec368b/istio-proxy/1.log" Sep 08 02:37:02.841867 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.841835 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-dt5np_cdd566e7-745a-49d3-821b-147d5408932e/istio-proxy/0.log" Sep 08 02:37:02.858476 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:02.858413 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-sc9qn_cf121abe-f8b6-4ad6-90e1-f601bf5393cb/payload-pre-processing/0.log" Sep 08 02:37:09.056695 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.056665 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/kube-multus-additional-cni-plugins/0.log" Sep 08 02:37:09.083269 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.083232 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/egress-router-binary-copy/0.log" Sep 08 02:37:09.109371 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.109346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/cni-plugins/0.log" Sep 08 02:37:09.135748 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.135718 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/bond-cni-plugin/0.log" Sep 08 02:37:09.159862 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.159836 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/routeoverride-cni/0.log" Sep 08 02:37:09.185702 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.185674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/whereabouts-cni-bincopy/0.log" Sep 08 02:37:09.207903 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.207880 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzlzv_dc5c85d6-40b3-419e-b4c2-e48b4ef86626/whereabouts-cni/0.log" Sep 08 02:37:09.254999 ip-10-0-142-110 kubenswrapper[2581]: I0908 02:37:09.254963 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tfrlr_142d8159-3245-491f-aa1b-380459fc9813/kube-multus/0.log"